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ABSTRACT 


In recent years there has been a considerable effort 
expended towards the refinement of adaptive control 
technigues. A large number of articles dealing with the 
general area of adaptive control and stability were reviewed 
as part of this thesis project. It was concluded that the 
generalized model reference approach to adaftive control was 
the most useful and that this could be further subdivided 
into two classes. The first, termed "direct" adaptive 
control, refers to any adaptive system in which the 
adaptation mechanism directly updates the controller 
parameters or control action. The second class, termed 
"indirect" adaptive control, denotes those systems in which 
the adaptive strategy inciudes an explicit identification 
step. The control calculation is then based on the 


identification model parameters. 


There are presently three distinct methods for the 
design of model reference adaptive systems. The first is 
based on gradient search procedures but provides no 
guarantee of stability. fThe oe based on Liapunov 
stability theory and on Popov's hyperstability theoren, 
guarantee asymptotic stability in the large. It has been 
Shown that both of these latter techniques offer the same 


potential for solving the design problem when the starting 
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point is a state space description of the plant and 
reference model. However, it was concluded that for 
adaptive systems based on input<output models, the 


hyperstability approach was more systematic and productive. 


The primary contribution of this thesis is an 
"Indirect", hyperstable, model reference adaptive control 
formulation that requires only input-output measurements 
from the process to be controlled. fhe proposed approach is 
based on Popov's hyperstability theory as used by Landau for 
"direct" adaptive state space systems. This "indirect" 
adaptive method guarantees asymptotic convergence of the 
outputs of the identified model and the unknown plant, plus 
convergence of the output of the identified plant to that of 
the reference model. Among other advantages, this approach 
provides a high degree of filtering to the adaptive control 


algorithn. 


The approach can also be modified to maintain a systen 
property other than stability. It is shown, for example, 
that a multivariable dynamic precompensator can be adapted 
to maintain the non-interacting (decoupled) properties of an 


unknown plant. 


Martin-Sanchez also proposed an adaptive control scheme 
based on an input-output description of the plant. However, 


it is shown that his approach can also be derived from 
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Landau's work and is not as general or powerful as the 


proposed method. 


Simulation studies based on single-input, single-output 
and multi-input, multi-output process sytems have shown that 
the proposed "indirect", hyperstable, model reference, 
adaptive control approach is physically realizable and will 
prowide the desired output convergence even in the presence 


of moderate noise. 
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CHAPTER ONE 


Introduction 


Although the so-called modern control theory is now a 
sophisticated and mathematically acceptable tool for the 
design of automatic control systems, there has not yet, been 
the expected rush to implement these technigues. Iwiifact; 
as several authors have pointed out [1 - 5], there has not 
even been mild interest expressed. True, a lack of trained 
Manpower has attributed to this gap between technology and 
practice, but perhaps a more philosophical reason 


exists. 


Betis the contention of this author, that the 
ili-defined problems which are more often that not 
encountered in the industrial world, are completely 
intractable to most of the modern control methodology which 
has been developed over the last two decades. It is an 
unavoidable conclusion that, the more sophisticated the 
apriori design technique is, the more complicated and 
accurate the process model must be. Further, it is in this 
aspect of the design that a good deal of the cost must be 
borne. Even in cases where adequate knowledge is available 
for the development of the dynanic model, there is doubt 


that, due to changing process conditions, instrument 
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defects, etc., it is of practical value anyway. 


Philosophically therefore, the requirement is for a 
self-adapting control system which can be designed using as 
little apriocri information as possible; which can 
restructure itself, or learn, to handle changes in process 
configurations; Which is simple to understand and implement 
and, most importantly, guarantees some measure of stability 
for the entire control system. Whilst such a scheme is 
technically not feasible at the present time, the field of 


adaptive control systems is attempting to meet this need. 


Regrettably, there has been a certain reluctance to 
look seriously at these techniques, probably due to their 
mathematical complexity and the sheer volume of theoretical 
contributions that are being made. It is this preponderance 
of literature that has obscured the essential features of 


what an adaptive algorithm is and what it can do. 


This thesis proposes to discuss adaptive control 
schemes and, in particular, the model reference adaptive 
control (MRAC) approach from both a heuristic and a 
mathematical viewpoint. The references, which are included 
should provide a reasonable start to the uninitiated; 


however, the list is by no means definitive and it is proper 
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to state that the structuring of the field has necessitated 
the omission of some detail. Further, since this work is of 
a theoretical nature there has been no concious attempt to 
compare the various methods, although it is difficult not to 
rationalize that the new developments are more productive 
and therefore should provide the basis for future research 


in the area. 


It is surprising that relatively little work has been 
attempted, in this direction, within this Department, given 
the interest in a wide range of techniques [6 - 10}. 
Indeed, this is only the third work which has appeared on 
adaptive control systems and the first to consider, 


theoretically, all the major contributions in the area. 


The work contained herein has primarily been directed 
towards examining the input-output formulation for adaptive 
control developed originally by Martin-Sanchez [11]. In 
doing so, however, it has been necessary to investigate the 
chronological development of model reference adaptive 
control and, because of the "dual" nature of these systems, 


model reference identification. 


Thus, whilst the emphasis is clearly towards the 
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generalization of the model reference technique, a major 
contribution lies in the structural analysis of the field. 


1.2 Structure of the Thesis 


The theoretical results of the thesis have been 
presented ina more or less chronological sequence, 
commencing initially with an overview of available adaptive 
onttol techniques. A literature survey is included to 
provide a stepping-stone from which more detailed research 
may be initiated. Further, a broad outline of the field is 


considered from a design point of view. 


Chapter Three deals with model reference type systems, 
providing a sequential increase in sophistication from 
gradient techniques through to the Liapunov stability method 
and, finally, to the method based on Porov's hyperstability 
criterion. All of these are, however, still state-space 


formulations. 


In Chapter Four a major break is made, with the 
discussion of the input-output formulation considered by 
Martin-Sanchez. The generalization of this model reference 
technique is discussed in Chapter Five, with a particular 
example being developed to illustrate the applicability of 


the concept. 
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Recourse has been taken to simulation to illustrate 
certain points of the theoretical approach. The results of 
these Simulations are discussed in Chapter Six. Further, iat 
has been noted that the concept is not just applicable to 
control or identification schemes per se. There are many 
instances in which a recursive on-line identification scheme 
would be of manifest applicability. A case in point is 
presented in Chapter Seven. Finally, in Chapter Eight, the 
overall conclusions of the work and several areas of desired 


future study are summarized. 


The amount of material which may be omitted obviously 
depends on the prior exposure of the reader to the 
mathematical techniques expressed in the relevant sections 
(a firm background in nonlinear control theory is felt to be 
desirable)!. It has been the intent of the author to try 
not to present, in too much detail, work which is already 
availabie in the literature, unless there is a clear 


compulsion to do so. 


= 


A particularly good reference in this field is the work 
Dy Siljaki[ 2. 
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Generally, it would be expected that some familiarity 
of the objectives and mechanics of adaptive systems could be 
assumed. Moreover, if a reasonable idea of the work that 
Landau has done is allowed, then Chapter Three may be 
omitted in its entirety. The main theoretical contributions 
of this thesis have been confined to Chapters Four and Five, 
with a conceptual summary appearing in Chapter Fight. It 
would be suggested that readers familiar with hyperstable 
adaptive system design restrict their attention to these 


Chapters for the first reading. 
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CHAPTER TWO 
Adaptive System Methodology and Literature Review 


morn Introduction 


it has been said that the theory of adaptation and 
learning "...is one of the most fundamental of modern 
science and engineering..." [1]. Undoubtedly the concepts 
of adaptation are widely acceptable in their basic TOrRsS, 
for they can be found at work, in some form or another, fron 


medicine to spaceflight. 


It comes aS some surprise, therefore, to learn that the 
science of adaptation is relatively new . To a certain 
extent it derived out of classical control theory, when it 
was found that there were some practical situations in which 
a conventional controller (ie. that based on a fixed control 
strategy) simply could not supply an acceptable performance. 
For example, a controller might be required to compensate 


for such things as: 


a) process transfer function variations, either in 
order or in parameter vaunes: with changes in 
environment. This situation is manifest in 
aerospace applications since the input-output 


relationships which describe an aircraft's flight 


Chapter Two 


~~ 


bas aoitetuabs to -<ya0gny fer 


? 


eae eee tacwehaut feo veda 
fay a 


toa 266 ELRAL Of ee das gene, 
| ae 
? 7 i¢ miat spee HA aes 


hed 


: 7 : 
pelle ff fon: ‘G.:si1802 fear: nas: ay au a7 U a 
calaedMe Booed MEE vipvivplod at so¥aataate, 2: 


Si bade Yopay Lor saag se wizerts 76. gua oyesb' gk Ml 
gienotd ats te p> pil ome 3199, (ee 
isneo 53822 sodo! beend hte ei) vfattestiien Lene: 


Z 


soeseiotaee 6fdssqesos. rs argue’ ou isos; vlgake 4 


it 


| Se 
stsanaqgec ot 697 liges a0 filpee aghfoaties: | vsigenne 2 


iA sen rere rs ae 


<9 i 
aa 
ne tedtia ~onotts bree nobyonv= yas an ots apaanre (Ss # 
Pt 
ni eepacdtiv. dtiw \eoulav) asqors zag oz ze T2REO 
gh -aGea0i0sh-“b cit sejta erit Jposrotives ‘- } 


7m . 7 wt ge 


yomscoings’ Sir sodte naotteoiigas eee 


; 
Sigh Gd G2 teat ice cy edbrsesh ithiaw aecqtidedoksefor’ ~ 
Oy : at Vr. 
- + > pear yy .” 
@ : i. 
= ' : 
: v . = 2 ps = ; ha 
7 JS ‘on 2 Sean as 


characteristics, 


can change with air speed, 


height, air pressure, etc.; 


b) changes in the system itself. For instance, 


many systems can Change quite dramatically over 


time through such varied causes as mechanical 


wear, or because of operational changes 


(ie. equipment malfunction), etc.; 


c) changes in the nature of the inputs and 


disturbances to which the plant is subjected. 


This can be especially prevalent in industries 


which may be termed "marginally economic" and 


hence are operated much closer to the constraints 


demanded by changing market trends. 


The motives for using 
dependent and examples may 
applications as well as in 
paper mill, the inertia of 


paper is wound on, and the 


adaptive control are not industry 
be found in paper manufacture 
arrcrart, control, ‘Thus; ian ‘a 

the winding reel changes as the 


motor torque, required to 


maintain constant tension in the web, changes with reel 


diameter. Ina missile, the mass and centre-of-gravity 


change as fuel is consumed 


and in a supersonic aircraft, the 


aerodynamic parameters vary widely as the plane climbs from 


sea-level to cruising altitude. Accordingly then, under 
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conditions such as these, the performance of a conventional 
feedback control system often degrades to beyond acceptable 


Lees, 


The obvious solution is to employ some type of 
ccentroller which accounts for these changes and may, in 
fact, use them actively in the pursual of the primary 
control task. Such a system must therefore measure the 
characteristics of the outputs of the control system and of 
the process under control and, on the basis of these 
measurements, adjust the overall system towards some 
previously defined optimum condition. This type of control 


system would typically be of the form shown in Figure 2.1. 


It should be noted that this description contains, as a 
subclass, any practical conventional control system, for it 
can be argued, that in these cases the performance index is 
measured directly and any major variations in the systen 
parameters can be compensated for by tuning the control 
loop. Thus in essence, the adaptive loop is closed, though 


manually. 
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2e2 Ciassification of Adaptive Control Systems 
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Davies [2] has identified six essentially distinct 


types of basic adaptive control systen: 


1) Passive adaptive systems: 
These static systems are designed to 
give adequate performance for a large range of parameter 
variations and environmental disturbances, using a fixed 


control strategy. 


In essence this is a most unsatisfactory 
type of approach since it can be argued that the design 
phase is based on a "worst case" philosophy. Not only is it 
difficult to define a realistic "worst case", it effectively 
means that "tight" control about a prespecified point 
becomes almost impossible. This last problem may be 
alleviated somewhat by a technique known as multi-mode 
Switching; a method which essentially specifies several 
types of controller, dependent on the system performance 
with time. 

2) Input Signal Adaptation: 
In this type of system the adaptation 


mechanism is purely a function cf the characteristics of the 
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input signal. The adaptive system is, thence, essentially 


open-loop. 


3) Plant Adaptive Control Systems: 
This type of control system adjusts 
its own parameters to compensate for process parameter 
Variations in the controlled plant. A subclass of this type 
of configuration contains the so-called model reference 


adaptive systems (MRAS), more of which will be said later. 


4) Parameter Adaptive Systems: 
Adaptation is achieved in these systems 
by directly adjusting the process parameters. Applicable 
Mainly to electrical systems, it is exceedingly rare to find 
this type of adaptive strategy used in chemical process 
Situations since the open-loop process parameters are rarely 


available for direct adjustment. 


5) Input Signal Shaping Adaptation: 

This technique appears to be potentially 
very powerful since the adaptive mechanism can be used to 
calculate an input signal to "force" the system to respond 
in some pre-determined way. A particular type of model 


reference adaptive control approach (the signal synthesis 
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technigue) operates in just this manner, as will be 


discussed later. 


6) Extremum or Optimum Adaptation 
Here the basic control scheme is 
adjusted so that some dependent variable is maintained at a 
maximum (Or a minimum) value. This apparently is a very 
common approach nowadays, aithough the method does not 
appear to offer nearly as many possibilities as those listed 


above. 


All adaptive schemes presented to date, can be 
considered as being designed with three, though not always 


distinct, phases in mind [3]: 


1) identification. 
In the context used here, this refers 
to the definition, at any time, of a desired system 
behaviour and a performance index. Such a specification may 
take many forms, varying from simple classical performance 
measures, such as rise-time, overshoot, etc., through to 
more sophisticated model reference approaches which specify 


a desired dynamic model. In its most general form, such a 
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model could consider long range economic goals as well as 


short-term control objectives [2]. 


2) Decision: 

This part of the mechanism decides 
how system performance relates to the desired response. 
Corrective adjustments are then made according to the 
algorithm used. Of the three phases of design to be 
considered in adaptive system configuration, this 


undoubtedly, is the most well-defined of all. 


There are essentially two basic types 
of algorithmic approach that dominate the literature at the 
present time: 
a) gradient techniques and, 


b) stability methods 


Of late, the stability approaches have 


virtually taken over the field, especially for the model 


reference configuration [4 - 9}. 


3) Modification: 


This process entails the physical action of 
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"driving" the system performance index towards the desired 
value. The choice of how this might be done can be narrowed 
to a certain number of alternatives, although this is a 


field of active research: 


(1) The process parameters, themselves, 
may be modified. This technique gave 
rise to the parameter adaptive systems; 
(11) The controller parameters may be 
adjusted. Quite popular, this technique 
has been classified as a plant adaptive 
system; 

(i111) An input signal may be generated in 
such a way that the process approaches 
the optimum position; 

(iv) A simple mode switch may be employed 
enabling the system to utilize a 
completely new algorithm, if a certain 
condition, dependent on the process, is 
met. (Or finally, 

(v) Some type of logic-directed 


controller [10,11] may be adopted. 


All of these phases are naturally, inter-related, but 
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it is true to say that, at some time, a designer must give 


consideration to each in a more or less separate context. 


At this stage it is proposed to discuss each of the 
above, in detail, as it is apparent that the individual 
schemes put forward tend to give greater cognizance to one, 
or at most two, particular aspects of the design. 


24 Ded Identification 


The decisions made during this phase often 
pre-determine the approach to be taken in subsequent system 
Specification, for it is at this stage that the index of 
performance and desired plant response must be decided upon. 
Indeed, the desired plant response specification is not a 
trivial matter since it is obvious that, by definition, no 
System can perform better than prescribed by its chosen 


optimum conditions. 


This decision must then take into account as many 
factors as the designer can foresee at the time, including 
perhaps even some forecast of economic trends and 


environmental variations. 


The choice of both the index of performance and the 
desired plant response are obviously affected by the 


measurements which physically can be carried out. For 
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instance, in most chemical process plants the states of the 
plant are not all available. Thus, a control scheme based 
on a function of the error between the state and some 
desired state is not very practical, unless some sort of 


State estimation scheme is employed. 


Given the inherent difficuities involved in these 
Ecc it is perhaps best to define some properties which 
would be desirable to include in a performance index. 
Firstly, the chosen index needs to be readily measurable 
"on-line" and moreover, it is essential that this may be 
done as accurately as possible. Secondly, the optinun 
region defined by the desired process behaviour should be as 
well-defined as possible so that there is ne ambiguity 
involved in the maintenance of this positicn. Thirdly, the 
chosen performance index should provide a good indication of 
relative operating quality over as large a process parameter 
Space as is feasible, and lastly, it should be physically 


meaningful. 


Unfortunately, many performance indices in use do not 
have all the above properties. Few are measurable and even 
fewer really have a physical significance. The mean-square 
error and integral square error indices fall into this 


category. These can easily lead to unstable or physically 
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unrealizable system designs [12]. 


The most common performance indices in use [13 - 23], 


can be described by the equation: 
J = fptet > fole) dt Coecececcccceccscocececeosecesceoccce( i) 


where e=e(t) is the system error. Unfortunately, this type 
of error criterion often fails to yield a unique optimun 


operating condition. 


When the input is not deterministic, but stochastic, 


equation (1) can be modified to become: 


J = fim /2r Runa to) foley) dt Sleliele alelelelelelelelale ee elelelas cleo) 


where £, (t) 1s generally, a strictly positive value. 


Finally, it is noted that any index of performance is 
by necessity process-dependent, for a desirable index for 
one system may lead to a completely erroneous result for 
another. Thus, in some situations, it would be "optimal" to 
have an extremely fast response to an input function, 
whereas in other plants the reverse might be true. In 
keeping with other authors [2,24], it is recommended that 


well-tried measures of system performance only, be utilized. 
As has been implied already, the performance index, in 
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some ways, specifies the desired plant behaviour, although 
this may be chosen by purely subjective analyses of product 
quality and the corresponding system performance. This 
approach is especially prevalent when the product 
specifications are only vaguely related to the actual 
operating conditions. Thus, iron ore pellet quality in an 
indurator, is expressed in terms of a "tumbling index", 
which is related to the fracture properties of the pellets. 
The difficulty here is that this figure is dependent on 
numerous conditions and, as such, does not define a unique 
operating pcint. In practice these problems are 
over-shadowed by purely prosaic considerations such as 


operator experience and biases. 


Most of the schemes used today configure the desired 
plant behaviour block in such a way as to correspond 
directly with some measure of the plant performance, eg. the 
desired steady-state operation is an obvious candidate for 
such a choice. These then, can all be said to include a 
conceptual "model reference" approach. The model of the 
plant which supplies the desired behaviour is, in fact, any 
dynamic or steady-state system which the designer feels 
properly designates the objectives of the plant under 


consideration (given the assumption of physical 
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realizability). The designer thus, can take into account, 
ideally, as many factors as is wished including the 
performance index. 


Sece 2 Decision 


This secticn considers the algorithmic approaches which 
can be utilized in adaptive configurations, Originally most 
of che procedures suggested were based on optimization 
theory [25 - 27] using surface-slope measurements as indices 
of performance. Eveleigh [25] has given a very good 
presentation of these earlier schemes, including those based 
on steepest descent approaches [28,29], periodic 
perturbation methods [29 - 34], peak holding systems 
[35 )- S99 ,Cand® signailivisynthesise { 40s, mMALSOF in) this work) 
there appears a summary of applications using these 


approaches [41 - 53]. 


It is now known that these techniques do not guarantee 
closed-loop stability [7,12] and this has lead to the 
development of other techniques based on Liapunov's direct 


method and Popov's hyperstability [54 - 65}. 


This choice is perhaps the simplest of all, since it is 
influenced primarily by the state of the art, which is 


clearly in favour of the hyperstability concept at 
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present [6]. 


Eales Modification 


As has been noted above, it is only in extremely rare 
cases that the parameters of the open-loop process are 
directly adjustable. This then normally necessitates 


modification of some supplementary control block. 


There are two common approaches to the design of 


adaptive control systems: 


(i) ccntroller parameter adaptation or, 


(ii) signal synthesis adaptation. 


The first category includes any scheme which has as its 
main aim, the adjustment of the parameters and/or structure 
of a compensator which subsequently determines the control 
action. A system such as that described by Figure 2.2 is 


typical. 


The second approach categorizes those schemes which 
depend on the isplementation of an input signal to achieve 
the desired index of performance figure. Figure 2. 3 


represents a general scheme. 


Examples of both systems may be found in the 
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literature, as well as those which feature certain aspects 
of both approaches simultaneously [1 - B25 766 Ye 


224 Qther Approaches 


Finally, other conceptual approaches are mentioned, 
since they are of considerable interest at present. 


Zot d Stochastic Methods and Learning Systems 


All of the techniques previously referred to have 
contained, as an integral part of their formulation, a 
deterministic nature, ie. noise characteristics are 
considered where they occur to be destructive and are either 
filtered out or simply put up with. The use of stochastic 
models however, includes the randomness as an active element 
in the pursual of the control task. In the control and 
estimation literature such algorithms are widely distributed 


[. 6,67 =68'); 


Another field of interest which is becoming 
particularly active, is that of learning systems. This type 
of system learns the unknown information during operations. 
The learned information is then, in-turn, used as experience 


for future decisions or controls. 


A very good presentation of the concepts of learning 


systems is contained in a booklet issued following the 1973 
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IFAC conference [69]. This booklet provides an overview of 
progress in learning systems with emphasis on their 
application to control problems. Reinforcement learning 
models, which originated from studies of the psychology of 


learning, are discussed. Learning algorithms, based on: 


(1) Bayesian estimation, 

(ii) stochastic automation models, 

(iii) stochastic approximation, and 

(iv) random search, 
are described and compared. The advantages and 
disadvantages of each learning algorithm, when applied to 
control problems, and the role of learning technigues in 
robot and manipulator systems are reviewed. Finally, a 


bibliography of learning control is presented. 


Another useful source is the work by Tsypkin fein 
which is presented a unified approach to the techniques of 
adaptation and learning . Both he and Lerner {70] have also 
included bibliographies on Soviet research in the area. 


26.5 Conclusions 


The general adaptive control system concepts discussed 
in this chapter provide a background for the more Specific 


material which follows. The references cited here should 
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give the reader a sufficient start in the various fields of 
adaptation and learning, although it is beyond the means of 
any Single authcr to cover in depth, an area as broad and 


detailed as this work has become. 


In view of the interest in model reference control 
systems (4 - 9] of late, the following chapters are devoted 
to these procedures. The general conceptual approach of 
model reference systems adheres to the design philosophies 


referred to above. 
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CHAPTER THREE 


Model Reference Adaptive Control Techniques 


SS oe a oe oe ee oe ae oe oe 


An adaptive system calculates an index of performance 
based on the inputs and the outputs of the adjustable 
System. From the comparison of the calculated index of 
performance values and a set of given ones, the adaptation 
mechanism modifies the parameters of the adjustable system 
or generates an auxiliary input, in order to maintain the 


index of performance values close to the desired ones. 


Of the myriad of possible performance criteria that one 
could imagine, it is certain now, that the so-called model 
reference techniques offer the most general approach 
{1 - 7]. Indeed the concept is well-based from a practical 
point of view, since the desired behaviour of the controlied 
System can be "forced" to take into account many dynamic 
elements that would be encountered, under normal operating 
conditions. These could include noisy measurements, 
disturbances, setpoint changes, time-varying behaviour and 


perhaps, even some classes of non-linearity. 


The earliest concerted efforts in the design of model 


reference adaptive control (MRAC) systems came during the 
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late 1950's and early 1960's. This was principally in the 
aircraft industry, for autopilot design. The incentive here 
was clear, since, under some flight conditions a human Pilot 
Simply cannot maintain control by purely manual means. Nor 
for that matter could a fixed control scheme offer 
Satisfactory behaviour, given the Tapidly varying 
conditions. An obvious case in point is the approach phase 
in the landing of shipboard fighters. Human pilots simply 
could net cope with such variable inputs as flight deck 
pitch, air turbulence, and stall indication systems, all of 


which may possibly be present under combat conditions { 8]. 


The problems of the chemical process industries can 
certainly be compared directly with those experienced in an 
aerospace environment. There is an enormous incentive for 
the development of adaptive control schemes (primarily due 
to cost factors). Indeed, since chemical plants are known 
to exhibit nonlinear and some time-varying behaviour it 
would appear a practical necessity. Moreover, MRAC offers 
an unique opportunity to look at the cost function since the 


reference model can be, theoretically, arbitrarily chosen. 


The MRAC systems suggested to date, may be broadly 


classified into three distinct approaches: 
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(i) gradient techniques; 
(ii) Liapunov stability methods, and 


(iii) those based on hyperstability. 


In the following sections of this chapter, these three 


classificaticns will be discussed. 


AS a necessary part of the chronological development a 
brief literature survey will be presented. For additional 
details the reader is referred to the several excellent 
Sutveys which already exist [1 - 7}. 


3.2 Gradient Techniques 


The techniques of the 50's and early 60's used methods 
based on gradient searches with the aim of minimizing a 
function of the difference (error) between the outputs (or 
States) of the reference model, and the actual process [9]. 
Thus, in the best known of these, the "MIT Technique" 
[10,11] (shown in Figure 3.1) the design objective is to 


Minimize an integral of the error squared, f c¢ dt. 


For this scheme, the parameter adjustment law is 


written as: 
€ = be oy. 7 oK Ge areola lee ee 0 ¢ 6\0 0 6 0 0 4 036 616.66 6 6101000 6% 6 60,08 1) 
& Pp & 

where K. is an adjustable controller parameter of the 
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systen; Y, is the output of the plant; b is a positive 


constant and « is the performance error. 


In this case, the sensitivity function, dy /ak , is 
Pp (S 
proportional to the model output, y,¢ and hence, equation 


(1) becomes: 


fo = ble ym eee eoeseneeeceereoaveesesseevsneceeccecscececcoeses( 2) 


where b' is the adaptive gain. 


This method has been very popular due to its 
Simplicity, although it may require a number of sensitivity 
filters for multiparameter adjustments. Several 
improvements (with respect to the speed of response) have 
been suggested. Among these, the techniques of 
Donalson [12], Dressler [13], Price [14], Winsor [15] and 


Monopoli [16], are notable. 


All cf the gradient methods however, suffer from the 
disadvantage that they are not globally stable [4,17] and 
hence, the adaptive gain, which governs the speed of 
response, is limited. Extensive simulations during the 
design stage are thus necessary to establish the region of 


stable operations. 
The stability problem was first demonstrated by 


Chapter Three 


we 


‘tata bal ay duane ond da 9 Nuance: 
yore rete AY — 


. % oy avis nde essvistieal say te 
woo ,.aoned Dats... ‘at 7 UGILO, bee) any. on 


2459 a 4 


= 


ea vebecin en hae ete en eee Sb ary ave 3 te ae 
f r . . i) ar. 
oe 


iy | ee aus adie 9 ab! 


nt i a ect ysteqog — naed asd wen at 

ppptiedes 50 19derg's shbagetr Tie O12, ‘\fepbd tn eee 

| ie ier se asrosteutes sesouasst este wt ® 

“~@yed jeeaaqess to Benge oat a Syegaes coke 
=» eowptudtet aa? a genes. 

Bas ¢ EF 1 comets. ae | sak 24 pery ret 

whisson se PPO]: 


Any i s ; \ 
i | ~ 


43 gout sukive \letaeed abndiaa wisi bere sia ao rs 


{ 


a 


pe (TT 6] eit Be TARO LY seae Ose YIa7 ted ‘aa 
29 tase ad?) sutSvuab “> ye hey ov 4sqane oft 


ady palms snoiialurce peperes 524 ‘ boa seed bg ane ‘* 
aN 


+ aadaaaegs oideds: 7 


aes 


sof Rod sedtanow shaver£s kv ee cidsiea ee 
r 


ue sX 
aétag. 1549809 | 
i Z. 7 
Py ; 
y ai 
Pigee 2 ii 
jee f is 


sie 


Parks [17] and lead, in part, to development of adaptive 
schemes based on Liapunov's second or direct method. 


3.3 Liapunov Design 


The technique, using a quadratic Liapunov function, was 
first suggested by Butchart and Shackcloth [18] although the 
implementation was later carried out DY) Parks fits) in. the 
redesign of adaptive systems formerly obtained using the MIT 
gradient method. The use of a more general Liapunov 
function by Phillipson {19] and Gilbart et al. { 20] has 
resulted in the introduction of feedforward loops that 


improve the damping of the adaptive response. 


The synthesis has also been generalized to 
multivariable systems, using a state-space formulation, by 
Winsor and Roy [21] and Porter and Tatnall [22] and the 
latter have also extended the scheme to time-varying 


systems [23] 


The "dual" problem of system identification using the 
Liapunov method has also been considered by several authors 
[24 - 29] and later work has extended the overall scheme to 


discrete systems [ 30,31]. 


Oliver [32,33] has presented a thorough experimental 


evaluation of the MRAC technique using a double-effect 
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evaporator, and has extended the control scheme to include 
setpoint and integral action. 


3.3.1 Theory 


The development is relatively straightforward starting 
with a differential (state-space) representation of the 


plant: 


x cn Gita @ Peel MED a Celslie e\els.e ee 7s1s ola es stele mre tina cclere cee Ctl) 
Pp P 


where x represents the nx1 state vector 
Pp 
u represents the mx? input or control vector and 
€ represents the px1 disturbance vector. 


A, Band D are process parameter matrices of 


appropriate order. 


Assuming multivariable feedback-feedforward control one 


can write that: 
= Kre x + Kpp & cecccccccccccescccccsecs sevccssecssece( 4) 
P 
OL, upon substitution of equation (4) in equation (3): 


. = + + + ) Gadrereie es slé-0 eee ele.0.e 6 oC OD 
x, (A B bop are CD B Koy os 
which can be written in closed-loop form as: 


x = A x aaa 2 EF cece vec cvcccccccccccsccccceseccccsee( &) 
p Pp P 
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where AY and s denote, respectively, nxn and nxp 


closed-loop parameter matrices. 
A desired closed-loop reference model is now chosen as: 
: = + eeeeeeeeaeeeeseeoveneneece e 
x 4. x a =) e eecoseccescecec( J) 


where x is the nx1 model state vector. 


A measure of the system performance, for the scheme, is 


Supplied. by defining an error vector, €, such that: 


eS = a4 Ceceeececeesceceesecrerecececvrcccecennsccesncec( &) 


Subtracting equation (5) from equation (7) results in: 
: = + —_ ar ae e@eeeseesceceeeoceeeseese @ 
= 4 £ C4. 4, x (2. 2, YE (9) 


and if: 


L ee. =i cise Case teiieiaio eiplie «4 ie'esnie'waieie 4 ects cinta cia cite cia iCLO)) 


then a Liapunov function: 
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P is the positive definite matrix solution of the 
Liapunov equation: 


ik 
+ = eeeeeceoneeecseeceaoeeeae @eeceszx eeeeaeceeeeeues 
a, & £4. g (12) 
and Q is an arbitrary, symmetric positive-definite matrix. 
a +e 7.9 and ae are adaptive loop gains and 
Cea Ve ne > n) 


and 6. (1=1. > ny j= > py) are, 
tea 1J 


respectively, the i, jth elements of A andd., 


Differentiating equation (11) with respect to time and 


uSing equaticns (9) and (12), with Q =) 2, One obtains: 


non 
See, OL CNyay ae indie 2b pha 
f=lj=1 LJ 1} PJ 1 1j 
Dye 
ay 
ee as 2 (i/d § =<: Ene Pp yo. eeececescececeesececeee( id) 
ft] 42] af ij j 4 1J 
where P 


In order that V be at least negative semi-definite, as 


required for stability, it is sufficient that ae and 
6.,=0 (ie. the model and the process are identical) or that: 
ij 
es T = 0 
1/a a +X 1 AEs 
Lye el PJ 1 
5 eb ier ibs! « ae SF da 
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+ = 7 G77 fs oe Jule k ty OD) @) wlayele eel 6 6 6) 4e.0 6.0 «e100 ees 0646 eee eet 15) 
These equations may be rearranged to give: 
ij PJ 


= 1 ar Ug ON a aes yD Salatoteiaieve eau lelais oe aie(s e)e 1s 014/6-6) aieleece al LO) 


in j= 1 > 4 2 ea i- DP eeceeceeccecccrecsceceesscececeseseceececee( iy) 


As Oliver [32] notes, V will decrease monotonically 
with time until either V equals zero or some positive 
constant. In the latter case this suggests that c=0 but 
also that (A = a and/or (Dd. a aE and, consequently, 
the closed-loop model and the process parameter matrices 
need not be equal in order that the error between their 


states be zero. 


The next development is to use the adaptation laws 


given by equations (16) and (17) to obtain an adaptation 
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mechanism that can be physically realized. 
Define: 


at EB 


Q = B Roy eeacoeve4uaeeevueeeenveneveeeesceececeoneete ececcecocceeceee( 18) 


Now, assuming that the open-loop plant and closed-loop 


model parameter matrices are time-invariant: 


Pk eerie taj 


= Lea + ey = -! eeoceeccecescsececocevccce( 10 ) 
m P P 
and: 
® =p eB, = =D = -(p + Q) = -g eeecececccsccscacsccescee( 20) 


mM. Pp Pp 


Using equations (16) and (17) in ccnjunction with the 
relationships, derived as equations (19) and (20), one 


finally obtains the adaptation laws: 


() 
v3 


Loe 1a als i = 1 > n ecoccccccccccseccseseccsesccvccese( 2i ) 
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This leads to a configuration depicted as Figure 3.2. 


The original theory is then modified, by Oliver [32], 


to include adaptive integral and setpoint control modes such 


that: 


ti 
Gt) = a Bt DS < Eee at 


4 cman) + (t) 
FF * ie 


Sp @eeeereseecececceeseececececeoecccsee( 23) 


where Se and Kop are, respectively, integral and setpoint 


control mode matrices. 


y(t) represents a qx1 vector of the so-called "integral 


States" [ 34) and: 


vOt) =) Cx Gt) eles e ele @ ele oes oe 610 610 6.6 6.6 616 e ele 6 ele ee atee@ 4 eet 24) 
Pp 


ie. the "integral states" are nothing more than those 
original states in which offset has been deemed undesirable. 


Pep represents the, at most, rx1 [34,35] desired values of 


the "setpoint states", 


Both these extensions are handled by reformulating the 
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problem such that equations of the form of (6) and (7) are 


obtained [32]. 


The main disadvantage of the Liapunov method is that 
the entire state vector must be available for measurement, 
which is not often possible. Extensive effort has been 
applied to this area, mainly in the addition of 
state-estimation to the original adaptive scheme, using 
Kalman filters! [36] and the so-called adaptive observers 
[37 - 40] which simultaneously estimate the states and 


parameters of an unknown linear, time-invariant system. 


There is also at least one study which uses the 
Liapunoy technique, as proposed by Sutherlin and 
Boland [41], and a full-order observer to reconstruct the 


entire state vector from measured inputs and outputs [42]. 


Another disadvantage of the Liapunov design rule is 
that it may not be applicable to those classes of plant in 


which the plant parameters are not directly adjustable. 


For a very good work on Kalman filtering, the reader is 
referred to a booklet which has been produced under the 
auspices of the Guidance and Control Panel of 
NATO-AGARD (80] (North American Treaty Organization - 
Advisory Group for Aerospace Research and Development). 
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Such a case was mentioned by Winsor and Roy [21] and a 
solution, though quite complex, was offered by Gilbart et 
al. [20]. Hang [43] has shown that this general adaptive 
ruie is restricted to the class of plants in which all the 
controllable parameters appear explicitly as individual 
elements of the plant and control matrices, He has further 


presented a design which alleviates this problen. 


=e 8 es ee Ss SS Se 


Of the two methods, based on absolute Stability, that 
derived from Porov's results in the field of hyperstable 
Systems [44 - 46] appears to yield the most general, 
practical and systematic approach. This is in Spite of the 
fact that, from a theoretical point of view, the approach 
via Liapunov's second method and via hyperstability theory 


have the same potential for solving the design problen. 


Landau [47], in 1969, was the first to present a 
detailed analysis showing how a nonlinear hyperstable system 
could be designed to carry out the MRAC task; although 
Anderson [48] had looked at the hyperstability problen from 


a positivity point of view in 1968. 


The theorems associated with these developments include 


all the results obtained by Butchart and Shackcloth [18], 
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Parks [17] and Winsor and Roy [21] using Liapunov's second 


method. 


The hyperstability work has been extended to include 
discrete systems [49,50] and series-parallel, parallel, and 
Series configurations have been investigated fat, 2751). Use 
has been made of the positivity lemma P52 \vand! positive 
definite kernels [52,53] to provide an alternate proof of 
Stability and several control schemes have been 


proposed [Sa - 59). 


A lucid description of the results of hyperstable 
System analysis can be found in [60]. In addition, 
hyperstability concepts have been used in several other 
design methcds [61 - 66] and for system 
identification [67 - 74] based on the "dual" nature of the 


MRAC technique. 


Although most of the work done to date by Landau and 
others has dealt with state-space systems, the results are 
readily extended to include input-output formulations as 
shown by Martin-Sanchez [75 - 77]. his, as noted in 
Chapter Four, has certain distinct advantages allowing, for 


example, the inclusion of explicit time-delays. 
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3.4.1 Theory 


An outline of the general approach, as detailed by 
Landau, will be presented for the continuous state-space 
formulation. The discrete formulation of Martin-Sanchez 
appears in Chapter Four as a distinct subset of the 


hyperstability theory. 


As with the Liapunov approach the starting point is the 


dynamic equation describing the plant. 


Suppose: 
x = A (Ct) x MM B (t) uu + D (t) ty eevcececscceccececcesees( 25) 
P P 
and: 
Y = C¢ x Cee cree secre esccccecreccececccscccescecccecese( 25a) 
P P 


where the A(t), B(t) and D(t) denote time-varying adjustable 


Open-loop parameter matrices and Yp is an rx1 output vector. 


A reference model equation is then chosen such that: 


, = 6 + sala #04 es alecesealsce es @neleisie|6 6's. /siejaie et: 20.) 
Bian An teu eS 
and: 
VY =C€¢ x Cece ccceraceree secs eevesscerecesccosecesccensec o( 26a) 
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The plant and model equations are understood to be of 
the same order (ie. the dimension of x7 1s the same as that 


of xs etc.). Defining an error vector, ¢, such that: 


[yi P< re CCCCH SCC CR>9C CC Ce CC EEC CC CC AeTCECCeeseececoceoececcesec( 27) 
E 


it is clear that an equation: 


& = Be aCe ee Are CE EGE ye aCe yu 
Pp m 


pret D a eae Gee dae eoeecsreeer es eseceosececececesrecsesenceesvecesee( 28) 
m 
can be written. 


The next development is to define a linear compensator, 


D, such that the output v(t) is given by: 


Vii. e. eee eee eesrescecesecececeeseseoceceeoscecececcscececccansend( 29) 


and assume that the parameter adjustment laws are of the 


following type: 


A(t) = & (v(t), t) 

B(t) = x Cv Ct dst) 
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where @,X and A denote nonlinear matrix functions of the 


compensator output, v(t). 


Finally, only those systems which Satisfy the following 


integral inequality are considered [48]; 


gT 


, 


ie 
0 Ct.) WOT) at 2-7 § eeeeececrcesccescccecetecececeeccecece( 31 ) 


where A, is a finite constant which depends on the initial 

State of the system and eventually on Sue fi'x(c) 1] but 
oO 

not on te v(t) is the output of the linear compensator 

block and w(t) is the output of a nonlinear block to be 


defined. 


The Popovian nonlinearity condition [44 - 46 j 
constitutes a subset of this approach. Suppose that the 


output of the ncnlinearity w(t) satisfies the following: 


OWS Ee eS Khcy GE) <n 
where k is a finite constant such that: 


0 <a k Ko 


The inequality (31) then becomes: 


Chapter Three 


ae ; ae : 
ee ay a a Car " are 
‘ 4 _ 4s 


= Bd . At ' 
a4 ; x 
+ we Tat 
Xt ; re ‘er oS . i i; 
; \ awe Wee ol “ a he ete o 
edz ‘to anoitvennd siatew Teor Lipoe) aime b 
| | ct i Ay Si 
fo ; i 3 4 


rinoliot od? 4 taetHa a tant AMI SES 


ery ‘panel a a 


we no whaeaeb A ye Ay tm  stuitos int 2 3 


we this) ‘tiene Tee Cup ne, hive, natpte em 
< y , ) 7 bi | 
360 63090 Mb D aon tf. ate om jig too) ant 2x siti ee 


sd .o4 Anglia geenllaen 6 ko oieaen enh ak 2 ne 
\ hs 


tae = 9) cation a4 Fisted sdiininden dae? 
sir J sit) eet gave EBS 6 ant? to soudu a 5 eviuah 


OF 


-Quivetlo? ada cette? dee one vi taagt ined eld to sons 


:'S a Pearet 29 


bY 


-) 


A : , 


fagmoned asdd (FE) qrilespoat e4v aay. x 


v af 4 feud : , a ; 
ti: aay re: 


son aa 


46 


t 
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0 
At this stage a theorem may be stated which determines 
the global stability of the entire system 


Theorem 3. 


, Sufficient conditions such that those model reference 
Systems described by equations (25) - (30) and inequality 


(31) be asymptotic hyperstable are: 


1) the transfer matrix: 
SCs) = DiCsy = JA yt 
mM 


be strictly positive real; 

2) the vectors TA feat a Oc) Fe (230 B(t))4u, 

Wueeat, D(t))& and v(t) be of the same dimension 
and, 

3) the computing block of the matrices A(t), B(t) 
and D(t) must introduce functions with the 


following forn: 
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O55 9843 and 844 are finite positive constants. 


Consider equation (25). If/a vector, Ww, is defined 


such that: 


w(t) = (A - A Ct))x +°(B - B Ct))u 
m p m 


TOR ge tte Coes eeeeececesrrececeeesenseceseeceoeecoeceseacese( Ja) 


then from equation (28): 
ie hae he ok 


eeoereeecereceoerecaescceoeeececexs ce sececanecvececseo( 33) 
m™m 


If equation (33) is considered with the integral 
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inequality (31) and equation (29), an equivalent system may 
be described such as that depicted in Figure 3.3. 

G(s)=D(sI - a is the transfer matrix of the linear 
block. For asymptotic hyperstability the strict positive 
realness of G(s) is required [44 - 47}. Condition 1 of 


Theorem 3.1 is thus necessary. 


The second condition of the Theorem follows from the 
definitions of w and the inequality which the nonlinearity 


must satisfy. 


Finally, the third condition can be shown to be 


sufficient in order that the inequality is satisfied. 


From the scalar representation of equation (32) it may 
be shown that a sufficient condition for the inequality to 


be verified is that integrals of the form: 
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LINEAR PART 
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NONLINEARITY 
w =F (v(t), t) 
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FIGURE 3.3 EQUIVALENT NONLINEAR MULTIVARIABLE CONTROL 
SYSTEM 
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i-=-A > n Paes i ee ca ecesscecececcecscecscececcscesceseceesecccces( 34) 


are applicable. 
haij biz and Aqijare finite constants which depend on the 


initial state of the system but not on CAME it. 


If the model is assumed to be time-invariant then the 


parameter adaptation laws give: 
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The inequalities (34) can then be written as: 
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where £i; (9), G35 (0) and hy, ©) represent the initial 


conditions of the corresponding integrals. 
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Theorem 3.1 is thus proved. 


Theorem 3.1 determines the way in which the parameters 
of the open-loop plant may be adjusted in order that the 
adaptive system be globally hyperstable. However, it is 
only in very rare instances that the plant may be directly 
adjustable, in this manner. The design of a physically 
realizable algorithm is, hence, not satisfied completely at 


this point. 


Of the practical schemes that have been suggested it is 
apparent that the approach taken by Bethoux and 
Courtiol [59] is closest to the "classical" configuration 
implemented by Oliver [32]. There are two differences in 
that Bethoux and Courtiol have made the assumption that the 
model and the plant parameter matrices verify 
Erzberger's [78] perfect model following conditions and, 
also, a proportional adaptive mode is introduced --- this is 


claimed to aid the speed of response of the system. 


In the approach to be outlined here, it is desired to 
point out the parallels existing between the two stability 
methods of MRAC design and, thus, the additional assumptions 


of Bethoux and Courtiol's work are not imposed. 
The configuration of the adaptive system is as depicted 
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in Figure 3.4 and described by the following equations: 


ea A x-CtO + Biaces © DEC t) 
P 


Y = ¢ x eeoeceeeceenecetreseeceseoeneenterneceseone eeecesececceseee( O7 


where the symbols are as for equation fa). 


Assuming multivariable feedback - feedforward control, 

one can write: 
ult) = &k (Ct) x + HER) SED Wyetete le iela wiele Me elehos a és oe coche 6 OAR 
FB p — ) 


Or upon substitution in equation (37): 


SPCtr =O CAT BK Ct) x F.0D + 5B K CC) Go e's a eietee (9) 
D FB D FF 


which can be written in closed-loop form as: 


x (t) = A (t) x isa 2B (+) fa Se eeeeececersecesecccrececscecceec( 4f) ) 
P P P P 


The desired closed-loop reference model is chosen as: 


2 CDR Eta wn eee 
mM ers m 
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PLANT 


ADAPTATION 


ALGORITHM 


FIGURE 3.4 "CLASSICAL" MULTIVARIABLE FEEDBACK - FEEDFORWARD 
SCHEME FOR MODEL REFERENCE ADAPTIVE CONTROL 
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Here, as in the Liapunov stability example, the model 


and the plant are assumed to be of the same order. 


Subtracting equation (40) from (41) and defining an 


€rror vector, £, aSs 


E&E =x aie, 4 eseecaesceescesceeessareseeeececeocecesceccvceccceseeces( 42) 


ce P 


one can obtain: 


Pe en ret CAL! MAL CR x OF ED DiC & iar bateletsiahaie ieee Ck) 
m m Pp Pp m Pp 


If a compensator, D, is defined such that: 
wee De © Coe eee secececsccccccccorcccrecccccccccccccccece( 44) 
and a vector, w, such that: 
wan Porto Ad Ghoveree tnt DOD CES) Boe oe eo le coc oe e O45) 
m 2) P m p 
then, one may write: 


& = A aay, + Be W¥ eoeeeeescocesvesccececcecsceccecesnceccccesccccoe of 46) 
m 
The next development is to assume that the nonlinear 
block, whose output is w, obeys the inequality: 


t 
ee ee wt Tipe TED -r8 Ceeccecccccccccceseseccesececes( 47) 
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where }, is a finite constant depending only on the initial 
State of the system. 
Further, require that: 


Bet) = ©) Ci C1t)'5' 4) UKE Gs 
Pp 


and: 


P(t) A €xtl2),5't) Uru oa sles alsleleiereleetelsleteterelele ss ieiele( (4) 
Equations (44) — (46), (48) and inequality (47) define an 
equivalent, autonomous, nonlinear feedback System such as 
that depicted in’ Figure 3.3. It is, therefore, by analogy 
with the results presented as Theorem 3-1, possible to state 
necessary and sufficient conditions such that the derived 
equivalent system (and therefore the original system) will 


be asymptotic hyperstable. 


Necessary and sufficient conditions such that the model 
reference adaptive system described by equations 
(44) — (46), (48) and inequality (47) be asymptotic 


hyperstable are that: 


1) the transfer matrix 
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G(s) = D (sl - ee 
be Strictly positive real; 
2) the vectors Ce Nas A (t)) x. (Ores Dy(tie and v 
be of the same dimension and, 
3) the adaptation laws for the matrices A(t) and 
D (t) must introduce functions of the following 


form: 


and: 


where OG and 844 are finite positive constants. 
The proof is analogous to that given for Theorem 3e1.¢ 


Theorem 3.2 defines how the elements of the matrices 
A(t) and Dt) Should adapt. However the elements which 


can be physically manipulated are K op and K or 


For the purposes of the following, define: 
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2=Bk eesesecesceoecesesceceseeceececcacescecececceeeccececc et 40 ) 


Supposing that the plant is time-invariant it is 
possible to obtain corresponding equations for the 


adaptation of Kipp and Kppe 


BK =| fa dete. <n | 


2 alk ge aa 9 mith G7 aka i) ae te 
P FB ij i pj 
and: 
MC ot eG tO Lae Bik =i nh 6 Vv E } ecececscecese( 50) 
p FF iq on 4 


The equivalence between the hyperstability approach and 
the Liapunov development is now readily established. To 
obtain asymptotic hyperstability it is required to design a 
compensator matrix, De such that the transfer matrix of the 
linear part of the equivalent system is strictly positive 
real. Using the Popov - Yakubovich - Kalman lemma [1,79] 
one obtains that D=P, where P is the matrix solution to the 


Liapunov equation (12). Further, 


Vin Gh aD eat p: @ecesecceccececeesececesrecceccesceseccecce( 51 ) 
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where D. is the i row of the compensator matrix Di COE Py. 


Thus. Wit C=I (ie. all the states are available for 
measurement) then the adaptation laws (50) reduce to those 
obtained for the Liapunov approach (equations (21) ana 


(22)). 


The equations may be further extended, as Oliver has 
done, to include adaptive integral and setpoint 


control { 32}. 


The development that appears in the preceding pages has 
shown the equivalence between the two Stability approaches, 
for the design of MRAC Systems. In general it must be 
concluded that hyperstability theory offers more 


encompassing results. 


Extensions to include unmeasurable disturbances and 
certain classes of nonlinear plant are also possible, since 
the difficulty of specifying a specific Liapunov function is 
avoided. The development of these are left until Chapter 
Five in order that they may be included in a still more 
general approach, utilizing input-output (ie. transfer 


function type) formulations. 


Chapter Three 


~ : : 1 : - Ree 
, ( - : } ® oe 
” Ls gal 
. ) ’ oy Pats ‘vis , ‘ 
~ ~ 5 ¥ f wae es } 
~ ro 
we ’ 4 ns 


g nia ee ios pRADAdOD ot yah “ re 


Zs 


$62 aldsiisvs OTA "SeFtH7S etd ue eae 


ae ; oe so0.) ¢ (Gc9 ra wat ; sk 389 jets, alt abe ts 
20 8 { } ey i i a 
Pc} ese Ope} is somqqe wonga oa ore 


° 3 30) 


ee 
j r ; 4 P Ps hee ‘ » Sane 
aed TS¥ elh. 2é VAAGIKS 79 ass 3-34 ab a: ‘ 
Sy F : Loe , ; ( P ‘i q 
teinctes fas Laavadak SY I9gene | 
} ) 


snk aepac ov Vc Ot 14 = eee 7 exgsagr 4 
saneoxaek viel edete ows “see enayy 7a ncaa sali sich 


 # he p af 2 


a0 Team 7S friadap, at 2 Mohs Pe eye.) te. sniteet pa 
a2 9%20/ yy s0sn3 Na i vie Seton bathe - ut> 
ea), ig? ; 2 12tL0OND, 8 


| 1 " he re a 
) ; 
Z 


hog, eesdedayserh, > (gerug agen g Aida i ‘aaean 
asnde wttiea 2200 og ke awh 498ia' shai stags to) eneabh #2 san 
et wo beaive ® eee i of xtoggs a a s yaRvaio age, a9 ‘yoTon 
se Iq hai J Lirho 2590928) meds 0) daengo faye al: amicin 
wing) Tiies 6 af be betort: ats fsa ysis Pads; apaae et id ovkt 
th22us2 4, ).oF) soddiige Pas paceetise,. a 


| Jaitod Fat s0% a? sepa | 


= 
ot 


hs 
‘ Do 


r- 
i 
i 
, 
* 


af eye 


60 


3-5 Conclusions 


The presentation of this chapter has centered on three 
approaches to the design of MRAC systems. This general 
outline represents a chronological development in the theory 
over the last twenty years or more. The chapter has dealt 
with state-space formulations primarily because, until 


recently, this has been the predominant trend. 


As will be shown in the following chapters, not only is 
this approach unnecessary, it appears to have been limiting. 
It should be noted here, also, that although only continuous 
systems were discussed in detail all these results are 
readily extended to discrete systems using the analogous 


discrete version of the hyperstability theorem [50]. 


From the point of view of the methods investigated so 
far, several observations may be offered. Firstly, the two 
schemes which guarantee stability are obviously more 
attractive from a practical and theoretical standpoint than 
Optimization/gradient methods. Secondly, the hyperstability 
approach can lead to more general results than the design 
uSing Liapunov's direct method. In particular, for the 
continuous example discussed, the hyperstable scheme becomes 


identical to that outlined by Oliver, when all the states 
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CHAPTER FOUR 
An Input-Output Formulation of the Model Reference Adaptive 
Control Problem 


4.1 Introduction 


Up until 1976, nearly all of the major contributions in 
the area cf research in model reference techniques, had been 
firmly planted in the state-space. This was in spite of the 
fact that formulations, using transfer function type 
notation, had already been suggested [1 - aye TENS 1S by) no 


means the case today. 


Despite the successes of the earlier schemes there are 
disadvantages inherent in the state-space development, 
namely, those of state-inaccessibility, time-delays, and 
general plant implementation problems, such as the 
definition of a desirable trajectory. Various adaptive 
techniques [7 - 16], or add-on approaches, such as coupled 
state-estimation [4], or state-variable filters 
[5 - 6, 17 - 18], and the like, have solved the problems in 
some cases. But for a truly comprehensive theory to be 
utilized in the manner that Popov has foreshadowed, it is 


necessary to take a step "backwards", 


The scheme presented by Martin-Sanchez [19 - 21] has 
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done precisely this -- reformulating the problem so that the 
Starting point is an input-output description of the plant. 
The hyperstability theorem may then be used in a somewhat 


Similar manner to that described in Chapter Three. 


This chapter will dwell on the theoretical aspects of 
Martin-Sanchez's approach. Moreover, even though only a 
discrete synthesis technique will be detailed, it should be 
noted, at the outset, that Martin-Sanchez's method does 
represent a true conceptual generalization of the 


State-space formulation for the hyperstability theory. 


The general structure of the adaptive control schene, 
utilized by Martin-Sanchez, can be depicted as in Figure 
4.1. In the diagram ¥ 4 (k+1), represents the "desired 
Output" vector. AS with the familiar model reference 
concept, the driver block determines the dynamic behaviour 
of the desired output and thence, the plant. This block, in 
fact, can be designed in such a way as to dynamically 
compensate for such practical phenomena as noisy 
measurements, and technically logical decisions may also be 


incorporated. 


The starting point for the development is what is 
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equivalent to a transfer function description of the 


input-output behaviour of the open-loop plant: 
h f 


ACK) Oy Ck ne EB Cid aa Ck = Fp) 
ae j=1 4 


VOC) Si 2 
1= 


& 
SF 2 B (kk) E(k - L) eeeccescerceccececococecceseec cece oeecccececsel( i) 


1=1 ji 


where y(k-i), u(k-j), and e(kK-1)) represent nx1 output, nx 
input, and px1 disturbance vectors, res pectively.!} A. (kK), 
B  {k) and D, (k) are time-varying process parameter matrices 


of appropriate order.2 


The starting equation employed here, does not include 
the time-delays explicitly as does ([21]. Instead, 
equation (1) is assumed to include elements corresponding to 
the time-delays as separate entities, i.e. a Change of 
variable can be assumed to have been made sete i =it+re 


and jn=. jin tt ,oubere ft and t are the time-delays. This 


If the number of inputs does not equal the number of 
outputs, then supplementary conditions need to be 
invoked [ 21}. 
2 


It is assumed that these matrices admit only a finite 
humber of bounded changes as k-+o. 
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approach has been taken to emphasize the generality of the 
solution. However, if the time-delays are approximately 
known, they may be included in the formulation so that an 
equation such as [I.1] [21] is obtained. This has the 
effect of reducing the order of the identification problen, 


and in practice, would be considered desirable. 


An identification model can now be defined as: 


hy fy 
BC) =) Su Aka lw = 2) +e DB ie = 1 aCKe- 5) 
“a ny aD s=] | 
i=l J 
Sty 
=f be De Cie 7= Ly eCKh = LL) Chclaiaiea leleale si eraiene alee 10 e) ee. a ete e eve 0U2)) 
eal ee 


and, an identification error as: 


e(k) - y(k) == d( kk) Seerececeevecrsreccccesrcecccsccevccscecesces( Gd) 


The identification model is assumed to be of the same 
order as the plant equation (1), ie. h,=h, f,=f and g)=g. 
This assumption is formally required mathematically, but 
there are many practical applications where it is difficult 


to satisfy this assumption, eg. distributed systems where 
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the theoretical process order is infinitet,. 


If we now introduce the vector, g(k), given by: 


~ 


isi ie fe 
CoA Me yOR, = ae er OB Oe atk oD 
=] 1 j=l J 


& 
+ 2 ee ae? eececececceoesaecesceeceesvecseceacceceses( 4) 


a linear transformation may be defined such that: 
s(k) = y(k) - glk) = 
h f 
b CAAK) —-2 (K)) vik 1) *2° (B OK) -—)BOOk)) uOk = gy) + 
si af j=1 J j 


Chapt?) Bok)? E(k - 1) eeoeccececcecececeeceesteesaseccael( 5) 


This transformation defines an equivalent mapping which 
reconfigures the system, defined by equations (1), (4) 
and (5) as an autonomous, nonlinear feedback 


system (Figure 4.2). 


ray 


The overall technique has been shown tc handle the case 
in which structural differences are present, under 
Simulation conditions [19]. In any case, it can be argued 
that the plant order is infinite so that during application 
the problem of structural differences always arises. 
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The discrete hyperstability theoren { 22] gives 
necessary and sufficient conditions such that a systen, 
configured as depicted in Figure 4.2, will be asymptotic 
hyperstable (which necessarily implies asymptotic Stability 


in the large). 


A necessary and sufficient condition in order that the 
System, depicted as Figure 4.2, be an asymptotic, 


hyperstable system is that: 


(i) the nonlinear element's input-output behaviour 
Should belong to the family whose characteristics 


may be described by the inequality:! 
Ky 


NOC Kgoy7kKy) = z Br CLD Ce Se Vky > Ko eececceee( 6) 
k=Ko 


A gis a finite constant perhaps dependent on the 


initial system state but not on time. 


This condition defines a "weakly" hyperstable 
system { 23]. 
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The proof of this theorem follows directly from that 


presented by Landau [22]. 


The system considered for this general theorem involves 
a nonlinear, autonomous feedback system, as depicted in 
Figure 4.3. The nonlinear element is assumed to Satisfy the 


condition: 
ky 
Mkgsky) = © vi Gh wilk) > — 12 Wk, > Ko 
k=kg 


Where A, depends only on the initial state of the systen. 


A necessary and sufficient condition for the systen, 
depicted in Figure 4.3, to be asymptotic hyperstable is that 


G(z) be strictly positive real which implies that: 


1) G(z) is positive real V{z]>1; 

2) the poles of G(z) lie in the circular domain 
[z{<1 and; 

3) G(z) + G*(z*) should be positive definite 


Hermitian vV{z{=1. 


It can be shown that G(z)=I satisfies all of these 
conditions. Moreover, setting S,=W, and s=yv, it is obvious 


that the inequality condition, (6), is sufficient. At the 
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Same time it is necessary, since any nonlinear systen 
satisfying inequality (6), is "weakly hyperstable", by 
definition [22]. Combined in a feedback manner with the 
hyperstable identity block, one obtains a hyperstable 


configuration. For proof of this last assertion, see [23]. 


Theorem 4.2 leads, finally, to sufficient conditions 
such that the identification system described by 
equations (1), (4), (5) and inequality (6), is asymptotic 
hyperstable. 


precter 4.2 


A sufficient condition for the identification system 
described by equations (1), (4) and (5) and inequality (6) 
to be asymptotic hyperstable is that the nonlinear 
adaptation laws for the matrices A, (x), B, (x) and D4 (k) 


admit functions of the following form: 
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Proof 


The scalar representation of equation (3) is used in 


conjunction with Theorem 4.1. 


For inequality (6) to be satisfied, it is sufficient 
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ee s 2() > - 2 Vky > Kg ecesecesecsececsecee( GS) 


where A, (t=1>n) are finite constants Only dependent on 


the initial state of the system. 


Using the scalar representation of equation (3), 


inequality (9) becomes: 
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In turn, sufficient conditions such that 


inequality (10) is satisfied are that: 
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a finite number of bounded changes as k->o. 
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Theorem 4.2 is thus proved. 
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The adaptation rules, given by the Theorem, are not 
directly useful in their present form since it is the 
identification error which is directly measurable and not 
s(k). It is possible, however, to relate s(k) to e(k) by 


means of a variable, diagonal gain matrix, K(k). 


The vector, s(k), is related to the identification 


error vector, e(k), by a variable, diagonal gain matrix, 


K(k), defined by: 
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Proof 


The theorem defines a relationship: 
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From the scalar representation of equation (5) and the 


adaptation laws introduced in Theorem 4.2, one obtains: 
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Or in matrix forn: 
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s(k) = K(k). e(k) 
diag 


Theorems 4.1, 4.2 and 4.3 define the asymptotic 


hyperstable identification systen, depicted jin) Figure 4.4. 


Ghe identification syster just outlined, is similar to 
that described by Landau [24,25]. However, as Landau fi25)] 
has noted, stable parallel model reference adaptive systems 
(which correspond to the “output error" method in recursive 
identification), always are affected by bias in the presence 
of noise obscured measurements. Although this bias may be 
reduced, significantly, if the adaptation gains are low, the 
obvious disadvantage would be the low speed of convergence. 
This observation lead to another scheme with decreasing 
adaptation gains [25], although more on this will be said in 


the next chapter. 


Now that an explicit identification of the open-loop 
plant is available, at all times, a control system may be 
derived. The essential step is to assume that the output of 


the driver block, ¥ , (k+1), is equal to the identification 
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A control error may now be defined as the difference, 
at any instant, between the values of the process output and 


the output of the driver block. So: 
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This procedure seems to have been inspired by work on 
inverse control schemes by Godbole and Smith, and 
others [ 26. — 31}. 
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It is now possible to show that the asymptotic 
hyperstability of the identification system also implies the 


asymptoticity of the entire control scheme. 


The asymptctic hyperstability of the identification 
scheme, defined by equations (1), (2), (3) ita) t) G15) cand 
inequality, (6), implies that the control system, described 
py weduat ions’: (4)), (2) 7) ¢3) 41) (14)... (15). (20) ,) C21). ana 
inequality, (6), is asymptotic hyperstable. 


Proof 


The proof of this theorem is dependent on three 


assumptions: 


1) that the input to the driver block and the 
disturbances are always bounded; 

2) the driver block is described by a stable 
dynamical system, and, 


3) B , (k) is non-Singular Vk. 


From equation (5) and the adaptation laws of Theoren 


4.2, the following equation is obtained: 


h 
BI) Fy Seok ba OE eae AAC eed Gkpe 1 ive 1) 


Chapter Four 


~< 


bd a 
one ; 


i490 I4aTee ads ere 1 baad " ; 
edt avifyut vets secede apie esanateb: a we geet 
| .snatve Eotknbs ene leadied wool $0: 


{ S ’ 
~ ; } ; ae 
oy Sips ow 
< . fe i a if 


As ay 

ckiepiai? ake 9 if ae Yate Mobhelinnge pancene tee 

ae 42h} 3 HP. sD ee Pil anczimipe ye Hapttoh , 
Saarzgage staya fous 109 #7 Jed? oat iqmk «18)) (tis 7 
pee WE) ROS) ERTL SOOT Hep, SD “ity bh 


»eidstetegya Sitosqayze ak”, 007. 


>. - 
c 


colds no Sephueqed ws ipuzoeite ures to boo sg., ca 


. +) 
oh: 


> 


any vile: AAG i Svtah ade os Sega ad? teds ir “a 
phehased opeals, o3s Bpendwdaid 
sldwie s va het bihaet at adarit qoPP 949 ‘<” 
,bas ,wesaye Lanemenys 
AY seLocate-nen et (a) 8 (€ 


2464 
= 


spingnh® *6 evel s@zéetcels edt Siw {e) aokisupe aats 


\ i 9 
:feciszdo 2! sodseppe paiveliot sdz. 5.8 


- 


* id ' - 7: 
b+ whe GOP = Dee ~ te) ao = (yee? ty = (ago 
. | ¥ [ut a | 
a a om 
j : : - a. ae 5 
ee 
% : ’ = F 
- “" Me : 


83 


(B(x) - OB Ce) - B.C - 19) ule - 5) 
j 


& 
+ v CD Ck) - AD (ky - DiCk - 1D De BL a ea I eseccececeeece( 22) 


z 
= 
tl 
= 
f 


BB Ck). = {Abe CK) ) = fe: s (k) u (k - j)] 
i jtq jt t q 


CE) ]4= Tes s (kk) sae, hs - 1)] 


ltq Le caet 


My ey eo Bitte $= Posmay a= t > pi ese cec ce eetseece ces ee el 23) 


Equation (19) may now be rewritten as: 


h f 
vite) = oD alk S/1yvcK =94) 4D (Boek Sa eee, =) + 
: ini} > jel 2 


8 


oy Dd (k - 1) ECk - lv) eieheleevereletele ciel ele eleleleje eis evereleceleteie e624.) 
Pelee 


and, so, the control error vector, ©, (k). may be written: 


Chapter Four 


MP Ta RDS US ee ears a 
ee 
‘i eye os 
= a nnn 
Agcy? 
t i e 
(4 ~ Bi th - ay 
x5 on oye ' ee 
ae Ja ree c7 © pee ! as a3 i 
ee | 7 
; 4 - 7 wr de s 
’ ye “ aha! { d & A = < ; ‘— 
bi 2 C2) jo) * yah pea? ' . 
: ey, . Pa. * Ete 7 
~, t' . ‘ : 
2 ; iH a Van 
f ho fa praia © ee? ee adn.) 
eta ia’ 7: std wate 
7 ; a ee ? 
4 \2 : is 
whe ; ; P+ aire , 
if * WI) 2.427 SB ai = then. Rh] ia} 
. a - +. par i) PRE t 13 
s aes Ny 2 r DS 
ee ae eee a ee tri ; 
ae Vea hae 
i . P 7 : c 
' wee bac , 7 : = ' 
) is eo tale ee a ru, = ta 
LS = 8m, Care iad ite Gale, ne T= eee 
, we .7 ip 
S/3e0ss uvpumbaeeat cee e Py a * ee | I> > ® s+ tse 
: . ‘o) 
ids aed hbiwen oF wea you (ef) notyaups 


~~ 


: : a | os 
* iy > Bie. t= 20g Fe eae re ee it + ne I.) = (3; 
Use | | fg v 
LOL kav eaeys rats pe Ce ef \-' #2) 08 -~ 21,9 a 


- shavenie- ad ven .(a)46 ,roseev sweade Iorrase $42 ‘fob! —-. fas 
7 > : ae , 


| 


c+ 
Ha 


84 


Cee ke OCR CDK DCm Ly eC = at) €25) 


ae ee) 


1=1 


Equation (5) can be rewritten as: 
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The last three terms of the right hand side of 
equation (27) will be equal to zero vk set. k2k,., where k, 
is some instant. This follows from the condition that the 
process parameters may admit only a finite number of bounded 


Changes as k >, 


Further, it can be shown that the assumption of bounded 
disturbances, coupled with the convergence froperties of the 
identification scheme [19], implies that the terms related 


to the disturbance vector always remain bounded. 


It now only remains to prove that the input and output 
vectors always remain bounded. Consider the hypothesis that 


at least one of y, (k-1-1) or ug k-i-1), (l1=1>n) >> as k>o~, 


From the asymptotic hyperstability properties of the 
identification scheme s(k-1)>0 as k+m. Therefore, 


considering the scalar form of equation (26), it is obvious 


~ 


sent ee es ace) 


must approach zero faster than vA Ect Or a ere 


that (2 jog fko 1) = Sequel and (b 


approaches infinity. 


Furthermore, from equations (1) and (20), it is 


manifest that (y(k-i) - y(k-i-1)) and (u(k-j) - wk 71) 
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Cannot possibly tend to infinity faster than y(k-i-1) and 
u(k-j-1). But this means that equation (27) implies that 
e,(k) will always remain bounded. Thus, frem equation (21) 
and assumptions 1 and 2, it can be seen that the process 
Output, and thus the input, always remain bounded. This 
result is at variance with the original hypothesis. The 
argument proceeds, then, that the input and output vectors 


are bounded. 


Finally, as the identification system approaches 


equilibrium, s(k) +0 or from equations (23), 


bA(K) > ee AB (6) > 0, AR Ck) > 0 


aun gee cw Ml ocay Gl tear iain) arg ere 


and so e,(k)>+ 0, from equations (22) and (25). 


This proves Theorem 4.4, 


Note: 


Theorems 4.2 through 4.4 inherently have assumed two 
further conditions which have not been explicitly stated in 


the proofs given: 
1e The driver block must specify a desired output 
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Such that the generated control action is 
physically realizable, ie. some type of projection 
technique which ensures that the identified plant 
does not contain right-half plane zeroes, must be 
employed. In particular, the final argument 
contained in the proof of Theorem 4.4 is invalid 
if such a strategy is not used, for u+>o if an 
unstable controller is stipulated and hence, from 
eguation (27) e@ (k) +”. 

2. The plant must be strictly open-loop stable. 
This condition is enforced to ensure a stable 


identification sequence. From Theorem 4, 3: 


mi ERS eS deg 
where: 
he An 
= + : a = 4 
eg ne a i/(1 a z Wit Oe (k in) 
i=lq=l 
£ n g P 
Ca a 82K — at OVS Re Gk =) Ty 


So that if y +m and u is bounded, it is possible 
for e(k) +» as s(k) +0. Once again the final 


argument contained in the proof of Theorem 4.4 
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will be invalid in such a situation as Y +a. 


It is essential to note that the theoretical results 
given above, have all been arrived at by Martin-Sanchez and 
are presented in an, as yet, unpublished papers Zi} g0 The 
important ideas, however, have all appeared in an earlier 


work [19]. 


Whilst the general approach of uSing an adaptive 
inverse appears to be quite sound (in fact Godbole and 
Smith { 26] suggested just such an approach in 1972) there 
are several objections to the methods and proofs that 
Martin-Sanchez has outlined. Firstly, as Johnson and 
Larimore [32] point out!, this type of approach is strictly 
only applicable for minimum phase model descriptions, since 
open right-half plane zeroes can lead to an unstable inverse 
controller which would then refute the proof of Theorem 4.4. 
Martin-Sanchez [33], in his reply, notes that this problem 
may be alleviated, somewhat, by insisting that the driver 


Elock never generate an output which will render necessary 


This same conclusion had been noted much earlier by 
Godbole and Smith [26] and Forney [230 J 
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Such a Situation. This approach necessitates more 


information about the plant operation than is desirable. 


It is true to say, thus, from a theoretical point of 
view, that a plant inverse method such as that described in 
this chapter, is strictly applicable to mininun phase models 


only. 


Further, it should be noted that it is also desirable 
to only consider, essentially, time-invariant plants, as the 
proof relies on the fact that at some instant the plant can 


be assumed to be stationary.! 


Another objection relates to the nonlinear adaptive 
relationship between the identification error, given by 
equation (3), and the vector s. It is quite possible, 
especially in a noisy environment, for the identification 
error to go to infinity as s>+0. An unstable plant would 
clearly lead to this situation -- the problem may, however, 
occur for other circumstances as well unless some type of 
projection technique is employed, which will ensure that the 


parameter estimates remain in a stable region [ 34]. 


I am indebted to Dr. M.N. Karim for this interpretation 
of finite, bounded changes in the process parameters. 
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Finally, the concept of the driver block appears to 
have been a central issue in this approach and yet, the 
design of this block from the point of view of output 
realizability, is not elaborated upon apart from noting that 
noise characteristics may be taken into account [iis eeike's 


noise filters may be incorporated in the driver block. 


In this chapter, the theoretical design of a practical 
adaptive control system using the inverse system approach, 
has been considered. This approach was presented by 
Martin-Sanchez in 1976, although previous work had been 
published in Spanish by the same author. Further, he has 
applied this scheme to a pilot distillation column, at the 


University of Alberta, with very encouraging results [21]. 


It has been mentioned that there are several 
aberrations with this technique that have not been regarded 
as suche The claims that Martin-Sanchez makes for his 


procedure must be viewed in this light. 


In the next chapter, there will be presented a more 
generalized approach than that reported here, using the 
original theoretical contributions of Landau. 


Martin-Sanchez's scheme will be considered as a subset of 
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this technique, although for the purposes of tractability, 


the adaptive inverse systen methodology is subsequently 


retained. 
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CHAPTER FIVE 


On a General Seif-Adaptive Control Scheme 


ee ee oe ee ee oe oe ees eee 


Of the various designs, which can be classified under 
the general heading of adaptive control, the model reference 
technigue has proved the most popular. In particular, the 
two general approaches which guarantee closed-loop 
Stability, hyperstability and Liapunov theory, have received 


a great deal of attention in recent Yearse[.m =eSie 


The general feeling today, is that Popov's 
hyperstability theory [6,7] offers the more widely 
applicabie results, in the field. Indeed schemes based on 
this methodology have been developed to include input-output 
formulations (see Chapter Four) which are probably the most 
practical system descriptions, given the inherent problems 


associated with state-space approaches Sete Je 


This chapter will introduce a general self-adaptive 
control scheme based on an asymptotic hyperstable 
identification method developed by Landau [14]. The view 
has been taken that any adaptive control technigue must be 
able to be integrated into actual operating plants with as 


little change of operating philosophy as possible. 
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The general input-output formulation cf the control 
problem allows a very practical method of implementing the 
self-corrective type of control scheme. In particular, by 
considering the outputs per se, it avoids the problems that 


most plague the state-space approaches: 


(i) explicit time-delays, 
(ii) finding a readily appreciable performance 
index and, finally, 


(f41) "state inaccessibinity. 


Of the various techniques that could be imagined for 
the implementation of a closed-loop model reference adaptive 


control scheme, two broad classifications can be identified: 


1) Direct adaptation of the parameters of a 
ccntroller/precompensator. Such a scheme is 
depicted an Fagure 5.1. 

2) Open-loop identification followed by parameter 


adaptation. 


An explicit open-loop identification of the 


plant is available at each instant. The 
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parameters of the controller can then be updated 
or a control signal calculated, to yield the 
required output. Figure 5.2 represents this 


technique. 


Whilst the first approach would appear to be the most 
straightforward for purposes of implementation, there are 
sone disadvantages. Firstly, an approximate knowledge of 
the open-loop plant (over and above the necessary structural 
information) is usually required [15 —- 16]. Also, some of 
the plant parameters are unreachable (le. physically not 
available for adaptation) in the more general case. To 
alleviate this last problem, a more restrictive Starting 
formulation must normally be accepted. The second nethod, 
meanwhile, suggests a much more fruitful procedure; an 
explicit identification is used in conjunction with a 
primary control block. The control and identification modes 
are Separated and, as such, the control block can be 
designed in any convenient manner Pav le In particular: .thi's 
technique offers the possibility of a genuine two-level 
control scheme such as that described by Nikiforuk et 
eit 14 Shah Dude 


5-3 A Particular Example 
To demonstrate the design philosophy briefly alluded to 
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above, a technique will be developed based on the adaptive 
inverse procedure suggested by Godbole and Smith [20] and 


later implemented by Martin-Sanchez eae 


Unlike most of the previous work, the present design 
approach is directed towards the adaptation of the 
parameters of the precompensator/controller of a standard 


multivariable feedback system depicted as Figure 5.3. 


For the sake of clarity disturbances are ignored, for 


the present, in this development. 


G 9, (2) represents the pulse transfer matrix for 
the open-loop plant and, 
K(z) is a precompensator/contrcoller transfer 


matrix. 


The input-output data of the loop, depicted in Figure 


523, Can be conveniently represented by the formulation: 
xy(z) = 0,02) r(z) Ut eee ie tite cal mae a isnt he Gl 
where G.,(z) is a closed-loop transfer matrix. 


Equation (1) may also be written, in the time-domain, 


ass 
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y(k) = fF Aa Gio yCaer—s ey + Te ae (k) POV — Tesi veieieie'@ 4 ¢Ci2)) 
Pate ea ame 


where y and r denote n dimensional output and setpoint 
vectors, respectively. = and B. are process parameter 


JP 
matrices, of appropriate order. These matrices may admit a 


finite number of bounded changes as k->~, 


A reference model is now chosen as: 
hy fy 
= owas ad ba ee2eeeneceeeee 
¥ 6k) padaets vk i) : Bin Ck rie, 3) 
i= 1 


where the m subscripted variables denote time-invariant 


model parameters, ! 


This model need not have the same structure as the 


closed-loop plant, provided that: 


hi <h 


and: 


£4 ft Coo CH CCS OSE HOSES ECE EC CECH HET CCLCEC CE OE CeCe seceseeeel( 4) 


Ana bDwe  Canerin tace.. aumitvay Linite: nugbper lor 
sean” changes® aS Kk +o. 
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If an error vector is defined as: 


e(k) = xk )—- y (k) 


coer ee ec eceeocccccsceccceccecscecccccecsece( 5) 


then from equations (2) - (4), it can be seen that: 
hy hy 
E(k) = i ben SOK - at 2 CA te 4,,¢*)) y(k - i) - 
i=1 i=l 
h £4 
2 A. Gk yvC kK =, 1). + Dy Bie me Boal kd 2K. oy ddal— 
ishyt1 ~~? nea i lh va 
fi 
YY Bik) xrlk —- Jj) eeseaneeceeceoeeceec es eerecesc cece eccece c( 6) 
j=f14+1 


This error vector then provides a direct measure of the 


current system performance! for the entire control systen. 


Define: 
i) 


VCE ) ics Vel kis » DBD, ECK — LY ceesccccerccrcccccevcscee( 7) 
i=l 


where D;, (i=1> pj) are the coefficient matrices of a linear 


Falter, D(z). 


Note that "measure of current system performance" has a 
different interpretation from the "index of performance", 
employed in Chapter Two. Here the term merely signifies a 
measure of achievement of the control objective. 
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Now lets: 
hy h 
; = =_ _ Wyss a, 
w(k) 2 C4. at? y(k a » EY y(k i) 
i=l i=h)+1 
f) f 
ze BGR = BF Ck) rCko= 9))'= > B. (kK) r€k - j) (8) 
joe an jp Fer rnp mals 
ands 
wj(k) = —-wlk) Tt Me ee eases eeseeeeasiecencesecececees el 9) 


where equation (8) is understood to represent a nonlinear 


function of v and time. 


Incorporating equation (8) into (6), one obtains: 


hy 


coal (i ee x A, E(k - i) * Lowtk) eeceoeseecececvcecceccccocccce( 1) 
fale 


Or, in z-transform notation: 
CC 27) Set = 2 ‘A: gi tyot wz) eeoceccccccevccsccceccece( il ) 
ig ini oe 


whereupon, from equation (7): 


hy 
v(z) = D(z) Cl= z Aan z iy-1 w(z) eececcccsccccsevcee( 12) 
i=l 
Or: 
v(z) = G(z) w(z) eee eceecsrexseceeccseccserecesecccceccecseeocec( ida) 


In acdition, it is assumed that only those pairs (Yew) 


Chapter Five 


tet ; 


, py: 
a 


aes 


iw 3 satdenpvennnnches'es tats tien sea Ena tan 8) i 
= - we ‘on 


ot buakeiee aa st (8) sok Phy #21 


ie oe 
Rad ‘bar x aw! > kat 


2 
r 
vy 
<r 
a 
w 
a 


gee | 


. ; ‘ 
pee bad de HF «AGT COWL TR sibvonis ‘eink Vabea Bogsor 
| MN . 
¢@ \ a 
| | Oy 4 cin . PY 1 ey eae 


¥T A 


(ir dee taee vere ee eee eens Thee. 5s ~ oe aoe 


4 


| _panitenata sree == 


2 ie | ae 
Bear “— 'ebe « ee en@eee eee tx i= ce Tx + gi Lo ~ii = 
oh) es Te an 
. ¥ ee 0) solPavpe pti 40 
bid | RRR Ea) 
CEL de ee 6408 eo 64K Oe Oe Care *Cr Ts a z 
| ae oa 


ees 


\ 


CeELIE denied ee Wher el iene eenedevees hay wee “ts 


ir . 2 | . * Tees 
F; abbey 
’ pk ee a2 icy nao? yiao! 2aa2 Sarees ak ot 


102 


which satisfy the following inequality condition are 


considered!;: 
k} 


NC Kg, Ky ) 3 Py v(x) wi(k) a= rG VkKi > Kg eveee( 13) 
k=ko 


where 1, is a finite constant perhaps dependent on the 
initial state of the system, but not on time. 


Se 3.2 Theory 


Equations (7))'=")(9)% (12); and inequality (13) define a 


System which can be depicted as in Figure 5.4. 


AS a basis for later discussion it is noted that the 
nonlinear control system, defined DY er gure) 5.4 as 


equivalent to the scheme represented Dy (Figure 5.5. 


Note that the approach illustrated by Figure 5.5 
implies adaption of the closed-loop plant parameters. This 
is easily done in simulation studies, but in experimental 
applications the actual plant parameters may not be 
adjustable. An alternative approach is presented later 


(c.f. Fig. 5.6) which alleviates this practical diffculty. 


ee ne eee eee eee 


This condition has been used to define a "weakly" 
hyperstable system [22]. 


Chapter Five 


re ae | OL) 
sui ae 
7 j x ia ml 
(ae . ’ ie 7 7 ' 
nat a Te oe = = 
i" - zs 


: ol wake thaws » Yenteaont'y 


| =e er oAlcey 
of fey yl 4 i 4 t them c 
: a4 a 


ves * St oe baageh agnd3eq tas tenes "senha! a 
eid 26. nd v3 ainda al is er a 


Lt / 
s etiteb. (er) sist eapent has: hh} ft) ~ ct) 229 


t.4 etapet tak ceca 

+ : ~ 

rad hated e298 ‘selecoad ie setal 708: ainad 6 
: a ks is, | 

& ty hbe args? 4 bani on eeye Ioxsaod 3 senet 


, 
a @ ome 


i= ok Po  . SUE LT rc batotuesied onehor oat hada sued 
j a = << 
.@ gumett yd hatnstow gt. sobiangi sity Sad tol 


‘ oe A © 
2 LY — 


> 


fesnse Len ra a2 a. eateesh joins seal omed thsi 


aiat es etonst oq rake coot~heealo all “to, oksqshs 


; cS | 
at toa Yan eraveuetsq tenly Seorae oie: saraies 
andes piece 2t dakoruas ¥ 7, jesnaits ah a 


‘ aeiak te feo iigastg alds mevarvelte Pere (2 


= : “e 


j i | ; *} a 
a 
Vea 
: - * = a >t 7 " ; 7 
A . au .” ’ i 
a ty Etna é eckner g? a rood aon. 


oe L552 § 


103 


LINEAR 
ELEMENT 
G(z) 


re 


NONLINEAR 
ELEMENT 


mah 


FIGURE 5.4 AUTONOMOUS, NONLINEAR FEEDBACK CONTROL SYSTEM 


: me ar, ‘ ie | er a Ps 7 - j 
bat mPa pe tel ttt 


i i 
“ ( : 
\i 
P ‘ 
oe 
x f 
; ay : Fa 
~ \ i 
bores 
« j 
“i 
el = 
~~ 5 
a a Sal baoteeeetinatieeiiied rs 


ve ARTA S 


en, Teper) 21) 


mr tart | ey | | 
. a a linea Poa, : 
: . y @8Ad 1woee - 
eATHNG, LONTWOT A ARRNT: SASWESAO QRORCNOROR | oe SANDERS 
i : r ; 7 : aot “a 
) J lj u coe a 


104 


G@WHHOS TOXLNOD AATLdIWAW FONAYAITR TAQCOW S°S gUunoig 


WS INVHOUW 


NOLLV.LdVdV 


THCOW 
HONDA AAS 
d00'I-dHSO'TO 


—) 


oat bie Te 7 


~ ~—s 
si *7 | 

} S y 

u mL 

: > 7S 

; ‘b | 
iz = ~~ 
~~ 


RED-CUOL 


105 


Landau has presented a theoren [23 - 24] which gives 
necessary and sufficient conditions such that the discrete 
nonlinear and/or time-varying System, Cepresented in Figure 
5e4, and described by equations (7) - (9), (12) and 
inequality (13), will be asymptotically hyperstable. 


Theorem 5.1 


Necessary and sufficient conditions in order that the 
System, described by equations (7) - (9)",/ (012) "and 
inequality (13), be an asymptotic hyperstable system are 


that the transfer matrix, G(z), given by: 
hy 


= = ~Ly71 
G(z) PEZINVGE cat 4. z ) 


ul 


is strictly positive real discrete in the sense that: 


(i) the poles of G(z) lie within the circular 
domain |z{<1 and, 
(11) 1G(2)" + GT(z*) Should be positive definite 


Hermitian. 


The proof may be considered as analogous to that for 


the continuous hyperstability theorem [Zo ts 


Using this theorem and the equivalence established 


between the systems of Figure 5.4 and Figure 5.5, it is 
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possible to state conditions such that the proposed adaptive 
control system is aSymptotically hyperstable. 


Theorem 5. 


Sufficient conditions such that the discrete, adaptive 
control system, shown in Figure 5.5, is asymptotic 


hyperstable are the following: 


(1) the transfer matrix: 
2 


Ee = rads yard 
Gz) = Dlz) (I Brit z. ) 
1= 


must be strictly positive real discrete; 


(ii) 

Pa Nes ee ee i) i= 1 > ‘hy 
4, pf) wk - 4) iS hiae iat Gj 
2. . - B,«)) r(k - j) ja is £; 
Bo fe?) oe = 5) pet tS ne 


and v must all have the same dimension and, 
(iii) the adaptation laws for Boety) and Po) 


must admit the following nonlinear matrix 
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functions: 


Dak Gt ag Meee (Ck) I] = La, v (kK) y (k - 3) 
2, Ebieg LE Lee Yel? ¥, 


4 Ck De las Pe Pa ast 0 v (kK) r (k& - §)] 
7 jtq ye Cie wiht q 


Cit and B+, are strictly positive coefficients. 1 


Equations, 44) -- (9) 5) (2) and inequality (13) define a 
discrete, nonlinear feedback System, such as is depicted in 


Figure 5.4, where: 
hj 
GC2Z) =O 2 VC = wie AN ety t 


im 
i=1 


ands: 


If the reference model matrices contain zeroes in any 
elements it is possible to set the corresponding gains, of 
the adaptive closed-loop plant, to zero. 
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* denotes a nonlinear functional dependence. 


In order that the system of Figure 5.4, or equivalently 
Figure 5.5, be an asymptotic hyperstable systen, it is 


sufficient (from Theorem 5.1) that: 


1) G(z) be positive real discrete, and 
2) kj 
mOKG, wad =e ry CN wee E> hye Vk, 2 Ko 
k=ko 
where h, is a finite constant dependent only on 


the initial system state. 
Thus, condition (1) of Theorem 5.2 is proved. 


The second condition of Theorem 5e2, follows from the 
definitions of w and W,- in that this condition must hold 


for either to be defined. 


The third condition may be proved by using the 


definition of wy: 


hy h 
wi(k) = ¥ (4a, (k) - 4.) VO =). po yr. Ai, (*) Vk =< At} 
i=l : i=h)+1 
fy £ 
+ PR GD = Wem G8 Sua > BAO) Bi od (al unis ie Rc cea B. (k) rk - Jj) (14) 
a ec jm fee ee 
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Substituting this into n(ko-k)), One obtains the 


condition that: 


k} hy h 
Oe tas es (Ai, 0%) Tin Abe ry. Gia = °3 1) pe ip) 
fy f 
x(k - i) + tie (By Ck) - Ba) atk = 3) Bere B,(«) 


Vky > kg SSeS C18) O-* 0 416 010 C06) e (610.0 10 6.6 6 6' 0 6,46 0):0'6 0 a0 616 0.0 60:6 60 et 15.) 


For this inequality to be satisfied, it is sufficient 


that the following scalar functions are verified: 
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independent of time. 


Introducing the adaptation laws, of Theorem 5.2, 


inequalities (16) become: 
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strictly, not accessible directly for adaptation in a real 
system. Instead, use is made of a compensator/controller 


biock. 
Consider the system shown as Figure 5.6. 


The closed-loop transfer matrix may be derived for the 


inner contrcl-loop as: 
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I is the nxn identity matrix; 

G o;, represents the open-loop plant transfer 
matrix; 

K is the controller/precompensator transfer matrix 
and, 

G is the actual closed-loop transfer matrix, at 
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any instant. 
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(Theorem 5.2). 


It becomes obvious, however, that a complete knowledge 
of the open-loop plant transfer matrix is assumed in this 
scheme. Whilst it is still possible to progress with this 
fesigat when limited information is available as to the 
variation in Go,;, there are simpler and more elegant 


approaches available. 


To overcome these difficulties, an augmented output 


method is considered (see Figure 5.7). 
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transfer matrix, Go,r is replaced by Gogt and adaptation is 
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That this system is asymptotic hyperstable can be 
proved in an analogous fashion to that detailed for Theoren 
5e2e Therefore y* > Y, 28 k > or from the principle of 
Superposition of linear systems Heed Seon es Kk > 7) where 


e*, represents the steady-state error between the outputs 


of the actual process and of the known Goatees 


Unfortunately, there exists a steady-state offset 
introduced by this technique. Once again this may not be 
disasterous if certain information, other than the structure 


of the open-loop plant, is allowed. 


There is one more modification, however, which will 
bring this proposed model reference adaptive control system 


more in line with the original objectives. 


The final step is to consider that Gece one NEeLe Gor 


Ss 
is an identified transfer matrix of the open-loop plant. 
Further, it can be considered that a hyperstable recursive 


scheme can be employed for this task. Thus, a system as 


depicted in Figure 5.8 would be resolved. 


It iS apparent that the system is again equivalent to 
that shown in Figure 5.6, with G or replacing G oy, and, hence, 
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y replacing y as the controlled variable. 
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Since the adaptation block 2 is assumed to be 
asymptotic hyperstable +0 as kK +». Also, adaptation block 
1, which effectively encompasses the entire system is, 
itself, asymptotic hyperstable so that Y>Y, asiiki> a.) This 
implies that ¥ ety Slaisik> =) by thecwpninciple of superposition 


of linear systems. 


Some discussion of the identification scheme is an 


obvious requirement, at this stage. 


Whilst it is strictly true that any asymptotically 
Stable identification procedure could be implemented, only 
those recursive schemes based on the hyperstability concept 
will be considered in detail. In particular, the scheme 
recently presented by Landau [14] and investigated by 


Ljung [26] appears advantageous. 
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The model reference structure has been shown to supply 
a very sound conceptual approach to recursive 
identification [14, 26, 27]. This procedure takes advantage 
of the so-called "dual" nature of model reference adaptive 
systems (ie. of the arbitrary way in which the model and 


plant are specified). 
It is noted, at the outset, that the approach below, is 
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essentially that taken by Martin-Sanchez te 21) in’ thie 
development of his identification scheme. This technique 
however, is more general and alleviates the problems of 
biased estimation, in the face of noise obscured 


measurements, for single-input single-output (SISO) systems. 


The system, developed below, will be equivalent in 
concept to the scheme presented by Landau (Seve SoLayanauli26.) 
has further investigated the convergence prcperties of this 
type of system and obtained criteria such that convergence 
of the estimates to the true values occurs with probability 


One. 


Suppose that the open-loop plant can be described by an 


equation of the forn: 
h 
ulk=- Jj) eoeccecesecce( 24) 
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where: 
y (k-i) are n dimensional output vectors 
u(k-j) are m dimensional input vectors 


A, and B, are time-invariant process parameter 
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matrices of appropriate ordert. 


An adjustable estimation model is now chosen such that: 


h f 


pee) fete AC ivi = 4) Ee 


B.Ck) Ck =). esecece( 25) 
a j 
i=1 J 


1 


where: 
y (k-i) are n dimensional identification model 
output vectors 


A, (k) and B  (k) are estimation model parameter 


matrices of appropriate dimension. 


It is noted, here, that there is no theoretical 
requirement for the estimation model to have the same 
structure as the open-loop plant. However, as a rule, it 
would normally be apparent that to ensure a meaningful 


identification it would be desired that this be SOs 


An identification error, ¢(k), and a vector, v(k), are 


defined now, such that: 


“a “a 


& = y¥(k) — ylk) SF SON SeO CxO Ci@ OL 8 8) C140 010160 AMO 6 6,0 010'6 6 66 6 4 6 0 614 6( 26) 


It can be shown that these matrices can admit a finite 
humber of bounded changes as k >-~, 
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ands 
0 Py ; 
2. £0k aa i) eeeeeccesecercecscesecsceccecccceeves el 27 ) 


vw(k) = ¥ 


=O. 


where Da. 


Using equations (24) - (26), one obtains: 


eed. aS: 
2, 


E(k) = A eGo chan oh (A; - A, (kK) vOk - 4) - 
1= 


f 
* CB. pay CY) utk - j) eeceesceecocecocececsesesccvoecssevsecee( 28) 


or, defining vectors w(k) and wy) (k) as: 


h bf 

w(k) = - CA Ck) = 4;) hig Cr aie ey's I Rey 7a MEA a B.) ak =) 39) 
i=l J 

eeeceseeceeseoecscecrececscececeoeree cc ecee ee eeececee cece ecene( 2) 
and: 

wi(k) = —~w( k) wee Ae SSO ee S16 6 Eid) @) 8 S)8)0167 0 @ a) ele 6 4) 40.0160 4) 016 610 6 CO) 
h 

£(k) = Dy A, Ck - i}y + wt) eceecereecsececceccsceccecccce o( 31) 
i=l 


Using equation (27) and introducing z-transform 


notation, equation (31) becomes: 
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“a 


v(z) = Diz) (LI = A. ao a w(z) eecececececseccccscecee( G2) 


If it is assumed that the adaptation laws for A, (k) and 


B ; (k) admit nonlinear functions of the following form: 


Ck) = [> Uys k Cie Ag 

it ny ee 
and: 

Ck) = n. { ° k ) k eeeececeececccosececsee( GQ 
x, CM seg Erk] Js ) 


then it is apparent that the system described by equations 


(29) - (32) can be depicted in the manner of Figures to it 


is further supposed that only those pairs (V,W,) which 


Satisfy the following inequality will be considered: 
k 


NCkog,yky) = L oy 
k=ko 


x 


ers wi(k) > Sa AZ Viki > Ko eceel( 34) 


where }, is a finite constant not dependent on time. 


Thus, it is clear that the discrete hyperstability 
theorem can be used to define an asymptotic hyperstable, 
recursive identification scheme. 


Theorem 5.3 


Se ee ee ee ee — 


In order that the system, represented by 
equations (24) - (27), (33) and inequality (34) be an 


asymptotic hyperstable system, it is sufficient that: 
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(B, = B (kK) ) u(k-3), (j=1>f£) and v must all have 
the same dimension and, 


(iii) the adaptation laws for A, (k) and B ; (k) must 


admit the following nonlinear matrix functions: 
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Peete = 8 ACK ee Orme ata Ck =" 1 )euren rong) 2, / 
jtq jtq jtq q 


OPicahrn BO Ck ST uate = 4) 7) 
jtq q 


Do ial te = ler on ee to 
itg and Bitq are strictly negative coefficients. 


Remarks 


v2 hevrirst "conditron, of the theoren isthe analog 
of the original condition for single-input, Single-output 
identification, first arrived at by Ljung [26] and later 


mentioned in an addenum by Landau VZo%s 


2. The introduction of the \} term can be seen as a 
method of affecting the rate of decrease of the magnitude of 


the adaptation gains. 


3. For A=1, one obtains the algorithm given in [14] 
only with decreasing magnitude adaptation gains for which 


G(z) becomes: 


G(z) = Plz) (I - CTS Mee Or i 
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4. For }+» , the decreasing magnitude adaptation 
gains Citg(k) and Bytq (k) tend to constant gains Witg and 


Bitqs and G(z) can be given by: 


Se According to Ljung [26], condition (1), given by 
the theorem, assures also that the parameter estimates for a 
Single-input, single-output system converge with probability 
one to the real ones, in the case of measurements disturbed 
by noise ( seis WS The proof of this for the multivariable 


case iS not available at this time. 


Anhauxibiaryivariablevys (k)astintnoducedisuchythat; 


WACK) = vO) t 8/2) wiCk) = YOR) IV Oui wlkl) oes ee 524035) 
From equations (28) - (30), one obtains: 
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Or from, equation, (27): 
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vCz) = Dz) Cy - 4. ziyv1 w(z) 


So, from equation (35): 


Ae ah wGs) =) 1/2h hws) 


y*(z) = D(z) (I - 
me 


h 
= (D(z) Ce AF Fre z 4. pa. a Ray 1 WY AED A il wl z) eoeecccesecoe o( 36) 


Also, consider only those pairs (v*,W,) which satisfy 
the following inequality relation: 
ah 
x v*(k) wi(kK) D - 6 VKi D> Ko eceocececcececcosees( dT ) 
k=k, 
where A, is a finite constant only dependent on the initial 


System state. 


Equations (24)\—) (27).) (29) "= (30) and) (35), — (36), and 
inequality (37) describe an equivalent nonlinear, autonomous 


feedback system such as that depicted in Figure 5.9. 


A necessary and sufficient condition for the systen, of 
Figure 5.9, to be asymptotic hyperstable, is that G(z) be 
strictly positive real discrete (from the discrete 


hyperstability theorem -- see Theorem 5.1). 
The first condition of Theorem 5.3 is thus proved. 
The second requirement arises from the definition of 


w(k) and of the inequality. 
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It is now required to prove that the given adaptation 


laws result in the satisfaction of inequality (37). 


For inequality (37) to be satisfied, it is sufficient 


thats: 


Xvi *(k) wa CK) > - A2 Vig 2 Ko 
t c t 


where i’, only depends on the initial state of the systen, 


OES 
ky 
v + r - 2 
My Cv, Ck) Lfi2 wa, (KD) Ci) 2 a 


k=k, 


and finally: 


aa 

ys v.(k) Wi (k) > - rA¢ Vki > Ko eoceccceccccccese( 38a ) 
kek, © E t 

O 
and: 

k 

i 

z T/2% wf, Cx) Pi dB. VkKi > Ko eoceeeeecececececce el GSb) 
=Ko 


The ineguality (38b) is always satisfied since \ is 


strictly non-negative. It remains to prove (38a) is also 
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always satisfied. 


Considering the scalar representation of wW1(k), (38a) 


becomes: 
ky n ie 
fe 5 vy tk) aes (iq - ip, (KY) Fk Sola yee 
Ligier! 
eke ‘pita: # Brig (KY) we GIVE 2 — AF wesw eee of 39) 


Sufficient conditions such that inequality (39) can be 


verified are: 


s 
of ~~ ~ ~ ee fi 2 
» eee Siege vk) y, Ck 5 Se 
k=k, 
GZ=trsoh, t=lsnsaz2=ii-z-ina 
and: 
a 
yA Peeua > Bee CK Vane Deas ile ia: eae eae 
weak vee jt t q lbjtq 


Vk 2 Ko Cece ecccccccccccccccsccccecscccssessccccsscsel( 40) 


and are finite constants which are independent 


Nee 
M tatitg lbjtq 


of time. 
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Introducing the adaptation laws, of the theorem, the 


inequalities (40) become: 


ky 

y a *. ~ “~ pd = 24S ns ~ 
a eet nr has 1) Vv, Ck) Pe i) Pitg (* 1)) ve 

fe) 
“~ ion “ ae 2] 
vos £ i Taita eereeecrveeeevesese SES SLO) CS) SO DS) 66. 5 6.6.8 6 16.6.0 °C. 6 6's 6 (4la) 
fo 1s thy, = 1 Ne -g = 1 > 2 
ai 

b. - £. k - 1) ¥_(k) =i ee Mate ka PAS Ee J 

fete Fea neta tea. Me haadea jtq ve 


Vki > ko cee eeescccccscccecscrecccccececcecccceseseececes( Sif) 


Inequalities (41) can be shown to be verified by using 
the positive real lemma [14]. Consider for example, 


inequality (41a). 


Lets 
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and: 

a * ji a A? @: se se ~ Js 
LUX) a itq ‘* 1) v Ck) Ve Ck i) eied Bee on 1)) 
St ko = i") 

q 


where, Citg™® (K-1) =~ O54 q (K-1) 1m Cita * (k-1) is strictly 


poSitive Vk. 
503 


Walk) = 1/2 a@*,. (kK - 1) VOK) me Oi gn) ete ek Y=. 1) 


Lo(k) = 1/2 ax (k -~- 1) Wk) ve (k - i) @isleieiecieies wee e(42D) 


Equation (42b) always satisfies a relation of the forn: 
XY wk) yCK) D> —- 6 V Ki > ko 


where A, 128 a fihite constant, since Ott g™ is always 
positive. It remains to prove that equation (42a) also 


verifies a relation of this form. Consider the 


correspondence: 


SOCK I> 20 k= 1 ee ACK) BOK) i ae OK = 2) F CK =H) 
itq q 
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PCk) > 1/a% Ck = "fy 
itq 
where, from the relation which describes the variation of 
Ci tg lk) with time (see Theorem 5.3), one has that: 
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ie. P(k) is always positive definite. 


Now one can use the positivity lemma for time-varying 


discrete systems. 


Consider the time-varying discrete system: 


SOK 44)" = AC kK) x(k) + BC k&) ul k ) eeeecececoccecsevnesececccze( 44) 


y(k) as CCK) x(k ) + ZC k) u(k) ercveeececececoecceseoseseecceec ce o( 45) 


where A(k), B(k), C(k) and J(k) are matrices defined vk. 
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The positivity lemma [14,25] states that the system 
represented by equations (44) and (45) is positive (which 
implies that an inequality of the Type (37) 1S Sati stred) it 
there exists two sequences of definite positive matrices 
L (k) and W(k) and a sequence of definite positive matrices, 


P(K), verifying, Vk20, the system equations: 


T 
ACK) PCk £1) ACk) - P(«) = -L(k ) TE Ce) e@ececeeccesceece( 46) 


pl¢K) PC k tet) ACk ) Sg C(k ) = owt) Caer) eececevrccee ne eof 47 ) 


Bai) ECE rCaIRE Oday oie) SON Ly BC ey ke ae) 


If W(k) is restricted to a sequence of invertible 


matrices, then (46) - (48) are reduced to: 


Bete) BCevet 9) Bic oe ecy eee th cee BC Ft} pce 2 ocd) 


(J Gn) doi pte poe + '1) Bde yr! 


Unie tes) EO Pols) AGI) = Clie): eececececeeccvoececeseeccecc cose oe el 49) 


Theorem 5.3 is thus proved. 
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Unfortunately, the algorithn again contains an inherent 
practical difficulty, that is, it is desired to calculate 
v (k) from equation (27). (Kk) USenot available, however, 
Since it is a function of the, as yet, unknown A, (k) and 
B,(k) ts. An outline of an algorithm to calculate v (k) must, 


therefore, be included. 
From equations (25) - (27), one obtains: 


p 
v(k) = vy(k) —- yk) + x D |e(k - dee) eooceccecccececccce e( 50) 


and: 
h £ 
vCk) = -y(k) + yi 4,(k) yk - i) + Y B.Ck) ulk - gj) + 
i=1 j=l J 
Pl 
x Dos elie S— 514) eeeeesesxeeesexseoseacceceoececececccccececccee( SI ) 
e ah 
i=l 
Or in scalar form: 
han 
“A i me yr 2 as a tee i oe 
ve) y, (Ck) ee Pee tae vq ( ) 
fame sth Degen 
L 
AMON Gk abi ghee rH Ya ha € (€k —- i) (52) 
j=lq=l Jeg q i=lq=1 1tq q 


Introducing the parameter adaptation laws, of 
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Theorem 5.3, in equation (52), one has: 


he <n 
“a ” oe ae am sb aA “~ We eae ‘ + 
v, Ck) y,(K) De Go arias 15) v,o«) Yq (k i) 
i=lq=l 
5h Pula i) 
Brg eh) fe vq CK = A) FING Manis CBipgk — LI vi CK) 
j=lq=l 
Pw 
ie hy eb ey Ck et pues Gk = U2 )14 a ase 
q jtq q ae q 
(k - ie) @yOle) 66101616 0160 616 e806 68 6 @ Cele cece cee eee oeooeee eee DO) 
a 
te SR a 
So that with some algebraic manipulation: 
vd = X/Y alevelelslelelererelelererelecelereletelcterelererelelelereielereleleieteleereie 6 (a4) 
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omy ie) i Dee ean LC gested tae) GT + 
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£- 0m P, 2 
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jziqzl t=i¢q=1 
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2 ys B ea aoe (k - j)) ececccesceceesececcecoe of 56) 


Finally, Ljung [26] has shown that Landau's scheme 
obtains parameter estimates convergent to the true ones with 


probability one, for SISO systems, provided that: 


1.2 the input sequence {u(k)} and the measurement 
noise seguence {n(k)} are Stationary stochastic 
processes with rational spectral densities and 
such that all moments exist; 

2. u(t) is independent of n(s), s>t; 

3. the open-loop plant must be asymptotically 
Stable (as well as the closed-loop system if 
feedback is present) 


4. D(z) = 1. 


If condition 4 is not met, it can still be shown that 
the output convergence is unaffected in the presence of 
noise obscured measurements [14]. 


5-5 Extensions 


The theory included in the previous sections has 


considered an example of a practical control system, based 
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On prior hyperstable identification. There are certain 
extensions which need to be outlined for this scheme to be 
fully acceptable in the light of actual Operational 


conditions. These can be categorized in the following way: 


The stability of the control plus identification schene, 
in the presence of disturbances (measurable or not) needs to 


be shown. 


Since the hyperstability theory is based on nonlinear 
feedback stability work, it should be possible to include 


certain classes of plant nonlinearity in the formulation. 


The calculation of the control block parameters can 
become quite horrendous for large systems, in that, in the 
general sense the method requires the inversion of large 
matrix polynomials, Whilst this is technically feasible, 
via Leverrier's algorithm [29 - 30], the task, even for a 
digital computer, is not a trivial one and in an on-line 
calculation mode may even become critical. Some 


Simplifications must therefore be considered and, finally, 
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On prior hyperstable identification. There are certain 
extensions which need to be outlined for this scheme to be 
fully acceptable in the light of actual Operational 


conditions. These can be categorized in the following way: 


The stability of the control plus identification scheme, 
in the presence of disturbances (measurable or not) needs to 


be shown. 


2 
Since the hyperstability theory is based on nonlinear 
feedback stability work, it should be possible to include 


certain classes of plant nonlinearity in the formulation. 


36 

The calculation of the control block parameters can 
become quite horrendous for large systems, in that, in the 
general sense the method requires the inversion of large 
matrix polynomials, Whilst this is technically feasible, 
via Leverrier's algorithm [29 - 30], the task, even for a 
digital computer, is not a trivial one and in an on-line 
calculation mode may even become critical. Some 


Simplifications must therefore be considered and, finally, 


Chapter Five 


ates sees eis ae 


ed OF shnedor Tr 10 isnt 6 0b bows: 45060 


[sno Seeueqh fanvoe: tn he tre 
you padeoiio? af stout aananas: li Lach a 


—y ~— 


Bas ). 
devddbe Seip apliisaets selqg Teagan —e ve yeklanoe 
| od abewa afon 20 eldewiesas) sana aha > sonscesd 2 


uw 


ay 


— > 


ype ts cr po foged ot sieeai: ersetansesoand edt 
Tintoad On at dideog ed biyode ree vane (iit biter 


oe 


ie es 
ad 99 oS ot, a4t pl pats eaattaon aaah me me £8: 


—-= 


) +9 “ag a 7 
Ne = ; 
@ ‘ : ie C in, pa ; 
«asm wreteparsg avold Lewtaos eA? 26 nok+aluntar edt 7 


oat eh, ear ni ,eeetars aprtel 1o6t ayotasziod onus 
oped te moiwzered ads aaztie: dodiga) ed? ganee | 


jeidhase’ ¢giftsubades? at etd. sa llay selaluod yfoq 
& 308 sate tee? ods (TCE - 2S) adtizopte = "a9 faye 
 ptit-20 28 af tas Sno Apt Lxs £ 208 at \tetegas tastpeo 

‘ 2eog . .faaitaae gaoved nero Tae abon no lealagigg shy 
Etieods hea hove eres oa e1ctezdy sane anc bseoktilente 


* : ~ : @ 
; : (pe : 4 
} 


[ a ~ 
sar n 
‘ _* re 
— “ - iu a a . : 
4 : oF 7 a | 7 
[ te 9 a 4 - - > ind 
; i , _s as ‘ it gts pees a 2 - 
i a © -_ 7 = oH, 


142 


The problems of right-half plane zeroes in the 
identification model and right-half plane poles in the plant 
description must be looked at froma pEactica lupointior 


view. 


Since these points are not critical to the development, 
which this chapter has attempted to present, all, except the 


last of these questions are discussed in Appendices. 


The last remark relates to the manner in which the 
control input is calculated. At present only one method 
exists for this computation, ie. the adaptive plant inverse 
technique. Since this method makes use of the inverse of 
the identification model, right half plane model zeroes will 
result in an unstable control input specification. This can 
be disasterous in practical situations although this is not 
a theoretical restriction. 


Se6 The Apriori Design 


Having noted the theoretical development as a 
continuing entity, with respect to new output feedback 
control techniques, the apriori design for the example 


problem can be seen to reduce to: 
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(i) Design of the compensators, D,(2) and D5(Z)5 
(ii) Choice of the adaptive gains for the 
identification and control schemes; 

(111) Initialization of the adaptive algorithms 
and finally, 

(iv) Specification of the reference model. 


5-6.1 Compensator Designs 


For the general scheme, depicted as Pagure: 5.8,\ two 
compensators or linear filters are required. The design of 
each is slightly different so that it is expedient to 


consider them as two separate problems. 


There are essentially three possible design methods for 


the filters: 


(1) algebraic positivity conditions for continuous 
time functions obtained via the bilinear 


transformation, z=1i+w/i-w, may be considered.! 


Karmarkar [31 - 32] has presented such a compensator 
design algorithir which ensures that the operation of the 
discrete model reference adaptive system is insensitive to 
initial parameter estimates, within a maximized hypercube in 
the model parameter space. 
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(11) state representation of the equivalent linear 
block, of Figure 5.4, and use of the positivity 
lemma [25], plus the solution of a Liapunov 
equation. This approach has been used in most of 
the practical work reported by Bethoux, Courtiol 
and Landau [15 - 16] and, 

(iii) Adhoc relationships which guarantee that 
G(z) will be known positive real, Vk. 


5-6.1(a) The Primary Control System 


The two methods that will be considered for the design 
of the linear compensator, Di), are the approach taken by 


Karmarkar, and possible adhoc solutions. 


D(z) is designed in order that: 
aa 


D162 )7 Cir = z Aon z 
i=l 


-ij-y 
be strictly positive real; where Aj, are diagonal, known 
reference model matrices. 


From Che definition of iv ¢e) (equation, (7F)., it is 
possible to state that D, (2) is diagonal. 


a) Systematic Design 


From the nature of the problem, it is cbvious that the 


design reduces to n SISO procedures, since for 
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G(z) (diagonal) to be strictly positive Lea) ats 


sufficient that St) ee Vo) be strictly positive real. 


Consider a typical element: 


°) 
rod, Ae? As Ge 


a ality 
5} 


eeeeceseceoee cose cccee( 57 ) 
i 


No tab 
— 


If the bilinear transformation: 


Zi= 1 + w/i 


= Wi 


eececeececececccecscesrecececececeecenececececcceescsse( SS) 


is utilized, then equation (57) becomes: 

hy h, 

ot i al 

e(w)'s z e; w ft b, w 
=O j=o 


eecececvececeeeceececcececceccccc es o( 59) 
Theorem 5.4 may then be stated as: 


pneorem 5.4 {34 - 33] 


For, 9(w) to vbe-~strictly positive real, it is necessary 
and sufficient that: 


(i) g(w) be non-degen 


erate: 
hl 
(ii) the polynomial ¢£ b;w De StLICtelLy ‘HuLWLLZ 
=O 
and, 


(111) Re g(jx)>0, vx>0. 
Condition (ii) implies that the determinants A 


1 
‘ni-l¢ coccee, Ay must all be greater than zero, where: 


0 
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Phat Phi Ui haraiatele «e's e's e's 6 ete vlate asc So eO 


hye Phi ) e@cevccece eG 


D1 OC cescceseccccssscescceee 0 bo by bo 

OM Nie ele eie slalslakee\a/auu soe. 8 ee 0'e oteieincig a0 bo 
and 44-1 may be obtained from “i by removing the last row 
and the last column Seal The convention is also adopted, 
here, that all elements with hegative subscripts are zero. 
This approach presupposes that a is at least positive 


feu J. 


in the practical approach, this procedure need only be 
done once, and merely signifies that the reference model is 


stable. 


The third condition results in the inequality: 


m 
1x2) = NY i eta Vx > 0 
i=o 


m = 2h, eeoeseeseceereececececeoneececercecesresercecececececceeccececccese c( 69 ) 
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Sufficient, though perhaps restrictive, conditions such 


that (60) is satisfied are: 


N 
oF (-1)/J oie nit Pape k even 
j=o 
and: 
N 
2 les Ls (-1)4 bys ei)< 0 k odd 
IFO 
N = 2k, Ko = 0, 1, eoer,y hy @eeceoeoeceocececcace se e( Gi ) 
It is obvious, from the relation between (58) and (59), 
that: 
irre fee) 1 VON eign de = Ol hy 
J ale 
and: 
eue=. PCa) i= Os hae d= "0 39 py 
A 4 
thus: 


where f(a), SEURY and Fi fapeds) are all linear functions, 


Since the a's are known. 


Karmarkar, at this point, formulates the design problen 


aS a mathematical programming exercise: 
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Minimize (-r) subject to: 


Ca; - ans =m) > 0 t= 00s hy 's f=. Oo > Pi 
and 
k even 
f,.€a; - Ends Samm) QO k odd 


where 1 and m take on all possible combinations among 
(-1,0,1). Thus, each function is evaluated at all the 


vertices of the hypercube. 


The resultant solution vector is: 


SG sy j = 0 > p, 


ae represents the desired compensator parameters and 2r* is 


the maximized hypercube edge in the model parameter space. 


It will be noticed, that strictly any D, (Zz) which 
Satisfies the inequalities (61) would suffice for the 
control system (provided that the reference model is stable) 
and, thus, the mathematical programming procedure is, 


strictly, unnecessary. However, the approach also indicates 
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over what range of model-space the compensator is valid and 
thus may be of help if the model parameters were to be 
Changed. 


b) Adhoc Design 


Since the reference model parameter matrices can be 
assumed to be known, Vk, it is obvious that D(z) could be 


chosen such that: 
a€(z) = Di (z) 8 Gog 


PSestrict ly) positive eng Where X(z) is known. In 
i jaa 


particular, if Dis Mae then, X(z)=I. 


ee a ee es Se Se ces See eee Se ee eee 


a) Systematic Design 


This time, it is required to design a compensator, 


D(z), such that [26]: 


G(z) = De(z) (I - 


is(istrictily: jyosi tijvei:real). 


Once again the A;'s and D»5(z) are diagonal, so that it 


is possible to consider n individual SISO problems. on this 
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(ii) Ane A-1? coccee sr AL are all greater than 
zero, wheres 


hol bh 0 CoeeeceececsvneesrseecenceseeeeD) 


h-3 oa ly, A a b, 0 eececececce ef 


bi O eeeecececoseeccecccccseccseece dD) bo by bo 


Ol Vararehersjalele}s.4 a) elelavielejele ale eels (ee.e) ala eieleul) bo 


and A-l is obtained from A by removing the last 
row and column of Ae Also b,>0 and, finally, 


(111) conditions (61) hold. 


The inequalities defined by conditions (ii) and (iii) 


may be written as: 


et f(a, ) lL ="1"5 th, 2¢=80"5-Fh 
and: 
cet i) > 0 k even 
= dd 
cy a we <r k o 
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Be (Olmos) de Os f= Os oy 
where, in general, £,(a,) are linear functions and Ty (ajyed,) 
are nonlinear functions, since the a,*s and dj's are 


unknown, 


There is a simplification, however, in the procedure to 
be considered in this chapter. Firstly, for the 


identification scheme D5(z) is assumed known and: 
Pe(z) = ne 


ie. for each diagonal element, of the compensator di] and 


ae =05.) (3-4 apa) 


Thus, the problem can be cast as a mathematical 


programming exercise: 


Minimize (-r) subject to: 


fila; = ey ou LoS 1 Shy ie l= 0 245 
ands 
f,¢ a5 4s Bride =m) >a 0 k even 
f.€a,; = peso, =m <<) 'O k odd 
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where 1, p, and m take on all possible combinations among 


(-1,0,1). 


The solution vector is (c*,a,*), (j=1>h) where a,* 
represent the "best" starting estimates for the 
identification model parameters. 


b) Time-Varying Filter 


By choosing D.(z) as a sufficiently good apriori 
uF 


estimate of (I - 


A.zty, the condition that: 
feb >t 


h 
Gtz)4> B92) Ggt= BGs Auesainsi teiyo0K4 


e nancy 
i=] 


be strictly positive real discrete, can always be satisfied. 


A rather natural way of using this idea is to let D,(2) 
be time-varying and let it equal the current estimate of 
h 
{To HoR 7 AvZ™*) at each sampling instant. This approach has, 
ie Lele 


indeed been shown to have a beneficial effect on the 


convergence properties of the algorithm [ 26}. 


The specifications of these three parameter groups are, 
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theoretically, quite anbitrany., Lita practice, however, there 
Will be certain choices of the parameters which will give an 
Optimum performance, in some sense. Tt is presumed that a 
performance index has been chosen to regulate this design 
somewhat, in light of the accepted practice for individual 


applications. 


Some general points which are process-inde pendent can 


be stated as desired objectives, 


1 The reference model would normally be chosen to 
tepresent a rational and realizable dynamical representaion 
of the plant. It would not, for instance, be sensible to 
Specify a reference model which has a response many times 
faster than the open-loop plant. Further, in view of the 
control configuration envisaged, it would be expected that 
the steady-state response of the reference model would 
correspond to the setpoint input vector. This implies of 
course, that the dynamic response of the model is Stable 
although, theoretically, this need not be so. D2) ma y 
Still be designed in such a way that the linear part of the 
equivalent nonlinear feedback system is pcsitive real even 


though the reference model is unstable. 
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2e AS a general rule, the identification scheme is 
required to converge faster than the outer primary control 
adaptive loop. This requirement would need to be considered 
when specifying the adaptive loop gains, although some 
freedom is allowed, in that, the gains of the outer loop may 


be changed at discrete intervals on-line. 


Sr Finally, as much information about the Planty as is 
known apriori should be included in the System description. 
It is not recommended that the adaptive loops be initialized 
in a random manner, for even though the overall system is 


stable convergence times can be theotetically, ‘infinite. 


There is one more practical problem that remains to be 
discussed before the relationship between the input-output 
formulaticns of Chapter Four and the general scheme of this 


Chapter may be investigated. 


Se ae we Se Se So se Se ee <= = oe ee = oe eee ae ee 


The design presented above, is strictly applicable (as 
are all designs of this nature) to stable plants. There 
are, however, some adhoc methods of utilizing these 
techniques when this condition is violated. This is usually 


at the cost of more apriori information. 
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Firstly,;cafithe plant ds unstable, but an approximate 
knowledge of the poles is available (as a result of some 
open-loop identification runs, say), then it is possible to 
analytically "shift" the open-loop plant into a stable 


region via the so-called "pole-shifting technique" {34,35 ]. 


For SISO systems, this procedure may be briefly 


described as consisting of the transformation: 


ux(t) = ult) - ay(t) 


where y is the output of the plant and a is a constant 
negative feedback gain. The linear Open-loop transfer 


function, G(z), is then transformed to: 


Bez) = G(z)/ (1 + aG(z)) eeeveesseeececeececececsesrececececceccec el 64) 


The design may then proceed as before. This technique 
has also received a good deal of attention, in the 


literature, for multivariable systems Oo hs 


Unfortunately it is not possible to shift Tight half 
plane zeroes, analytically, using the adaptive configuration 
aS shown in Figure 5.8 and usually recourse is taken to 
pole-zero cancellation methods [ 20, 34, 383}5 Forathe 


present adaptive control scheme, however, there are some 
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adhoc considerations which may be taken into account. 
Firstly, if it may be assumed that accurate parameter 
identification is not a prime goal then the identification 
model may be constrained to a minimum-phase region. This 
would allow the output convergence of the identification 
scheme without the risk of an unstable control input being 
generated. Secondly, the gains of the outer adaptive loop 
may be adjusted to achieve the same ends. Both inherently, 
govern how fast the system approaches the desired 


trajectory. 


The similarities between the general augmented output 
control technique and the method of Martin-Sanchez can best 
be outlined with the use of a block diagram. Several 
Simplifications must first, however, be included in the 


mathematical development of the general scheme: 


1. the adaptive gains for the identification 
block must be considered, constant, strictly 
negative quantities; 

2. the reference model must admit the same 


dynamical form as the driver block and, 
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3. the control action should be obtained via the 


equation: 


na 


uCk) = BilCkdLy*(k + 1) - 4. vVGk = 7 + °1) = 


f 
i Se ie uk = J a 195] eeeeereceececsrecesceceecveccsccecovcecec( 65) 


where y'(k+1) is given by: 


in 
xw'Ck + 1) = z At Yee hedisnin Saat: (J) ie hip 2 


eececrveceoeeceeccecrececseesesesceneceecesece( 66 J 
y' (k-it1) are the n dimensional driver block 


output VECtorcs, 


r(k-j+1) represent the n dimensional setpoint 


vectors. 


A;‘, B;* and Dj" are parameter matrices of 


appropriate order. 


Given these simplifications, the general scheme can be 


depicted as in Figure 5.10. 


The approach can then be shown to reduce to 


Martin-Sanchez's scheme for: 


(i) D(z) =0 
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(11) y' (k-it1) and y(k-i) considered to be plant 
outputs and, 


Gi) Do@y=(- 2 Ayca2 4). 
e 


As before, the conclusion is that this system will be 


asymptotic hyperstable provided that: 


1) the open-loop plant contains no Tight-half 
plane poles (ie. it is stable); 

2) the identification model has order greater than 
or equal to that of the open-loop plant, and 

3) the identification model does not enter a 
region in which it contains Light half plane 


Zeroes.e 


Although only the case of control parameter adaptation 
has been detailed, it is possible to carry out the control 
task using the signal synthesis technique of Chapter Four, 


Such that: 


i 
ulk) = B71(K)L SECs acy nT A Ck) nr te ee aye 
fl 
g 
r 


prCk) nocett jiapipt= Di CROREC KE het) Wine C670 
J 1 


1=1 


where ¥ g (k+ 1) is the desired output at the next Sampling 


instant. The latter may be obtained from the model 
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reference output or via the primary adaptation loop 
parameters, In equation (67), the influence of measurable 


disturbances has been added for generality. 


It may be noted that these two techniques are identical 
for the case in which the adaptation of all variables is 
Carried out at each sampling instant. The former method, 
however, has the advantage of allowing for differing sample 
times between the adaptation loops and the primary control 
loop. This has important ramifications for industrial 
implementation although no analytical proof of Stability, (in 


between adaptation times, is available at present. 


cr 4 re es SS ee ee ee 


A very general adaptive control configuration has been 
described, in this chapter. This technique was considered 
as a subset of the overall conceptual approach which may be 
described as apriori identification + control. The scheme 
is as general as possible, and several practical aspects 


have been discussed. 


The proof of hyperstability, for the general scheme, is 
a powerful result implying as it does, asymptotic stability 


in the large [22]. 
A list of practical advantages of the proposed method 
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could include: 


v. The entire control plus identification scheme has 


been designed with guaranteed hyperstability. 


Ze in the absence of unmeasurable disturbances, an 
explicit identification of the open-loop flant can be 
obtained (although no guarantee of parameter convergence for 


MIMO systems is available), 


i Little apriori information is required. 


4. The flexibility of the transfer function approach is 
maintained through use of the input-output formulation. 
This negates, effectively, any problems of state 


inaccessibility, etc. 


Se The method is able to handle square or non-square 
plants. 
6. At the cost) of a ittie more information, unstable 


plants may be included. 


We K, allows the possibility of dynamic decoupling of 
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the closed-loop plant (see Appendix 5.2 -- equat@ron 123) )\. 


8. Disturbances do not affect Stability, although 


unmeasurable disturbances will upset the identification 


problen. 
9. _ The controls to the plant can be constrained foots 
10. Known information about the plant may be 


incorporated since the adaptation loops can be initialized 


uSing this data and the gains adjusted accordingly. 


Mil's Some nonlinear behaviour of the plant can be 


allowed for and, finally, 


Ie The provision has been allowed for different 


Sampling intervals for the primary control loop and the 


adaptive loops. 
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CHAPTER SIX 
Simulation of a Hyperstable Adaptive Control Scheme 


6.1 Introduction 


— oe ae yy a reo oe ae 


The salient features of the design of hyperstable 
systems are difficult to pinpoint using a purely 
mathematical presentation and hence, recourse has been 


taken, here, to simulation studies, 


In this chapter, there will be considered five systems 
~~ two single-input single-output (SISO) and three 


multi-input multi-output (MIMO) configurations. 


Because of the complicated nature in which even Simple 
MIMO systems interact, the major effort has been directed 
towards the SISO simulation study; the MIMO examples being 
included for the sake of completeness. This does not 
restrict the presentation in any way, since the effects of 
the design parameters should be more apparent with this 


approach. 


This chapter is best read throughout, rather than 
piecemeal, since interpretation of the simulation results 
depends, to a certain extent, on an understanding of the 


implications of each of the parameter sets, investigated. 
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AS was mentioned in the introduction, the major thrust 
has been directed towards an investigation of the effects of 
the design parameters on the performance of the adaptive 
scheme. As such, the SISO examples are considered £iTSt, 


utilizing three modes of explanation. 


Firstly, in each case, the major parameter effect to be 
considered will be mentioned as a ‘subtitle. Secondly, 
reference will be drawn to two or more particularssetsiof 
figures which show the effect in question. Lastly, a 
textual interpretation of the diagrams will be presented 


with brief references to design implications. 


The MIMO examples appear towards the end of the 


chapter. Three systems have been referred to: 


(i) A second order system? [1] with open-loop 


transfer matrix: 


Note this formulation is equivalent to a State-space 
representation. 
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2/(s + 1) 17 Ce ra) 


Gils) = 


b/Ce ct ,) 1/(s + 1) 


and poles at (-1,-1); 
(ii) A fourth order system with cpen-loop transfer 


Matrix: 


2/(s. + 1) 1/Gs > .1) 


Gols) = 


L/Cs 1) 1/(s + 10)2 


and poles at (-1,-1,-10,-10) and zeroes being 


=9 + 775 , vespectively, and lastly, 
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(iii) A sixth order system with open-loop transfer 


Matrix: 


1/(s + 1)(5s + 4) P/COsts 4°19 


Sats) F= 


1/(0.1s + 1) E7CSs tH) G0. 28+ 4 3 


and poles at (-1,-0.2,-0.2,-5,-10,-10) and zeroes 


at (0. ,7025 009 5-5.0)), 


Before proceeding, however, it would be practicable to 
review the adaptive system configuration and the computer 
algorithm design. 


6.3 Hyperstable Adaptive System Configuration 


The simulations have been carried out using a 


configuration such as that depicted in Figure 6.1 


In all cases, D,(z) and D.(2) are equal to the identity 
matrix, I, and the control action has been calculated using 


an adaptive inverse technique. The majority of the 
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Simulations have also included a measurement noise input 
which is simply added to the actual plant output before 


being used by the identification mechanisn. 


A series of user-oriented control programs have been 
written for use on the University's Amdahl 470 V/6 computer. 
In particular, two sets of programs -- IDENT1 -- and 
—- LANDAU -- were used to implement the simulation studies 
reported in this chapter. The former program was used only 
for SISO examples, as it was designed solely for this 
purpose. The latter, however, is a general purpose 
multivariable simulation program which allows the user a 
number of important options, including multiple step 
setpoint changes, control constraint Options, and an 
interface secticn to a general plotting program -- PLOT. An 
illustrative flow diagran demonstrating the options 


presently available is included here as Figure 6.2. 


The user is prompted by the program to enter relevant 
data at various points and error diagnostics have been 
included to flag certain illegal actions. The data file may 
then be editted and the program restarted. At present 
~~ PLOT -- must be run as a separate module from -- LANDAU 


-- as it has been designed for general plotting tasks not 
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The algorithm used by the adaptive control programs can 
best be described as a number of sequential steps executed 


at each sampling instant: 


We the plant output, y(k), is measured 
(calculated). 

2. If the measurement noise flag (is set, ithe 
program calculates a measurement noise component 
and adds this to the plant output obtained in 
Step.) ile 

32 An estimate of the identification model 
Output, y®(k), is calculated from past values of 
the noise corrupted plant outputs, y, the plant 
inputs, u, and the identificaticn model 
parameters, A,(k-1) and Bi {k-1), (i=15h, j=1> £) 
from the previous instant. 


4. The identification error estimate, 


Further details of) programs and’ options that are 
available for use in adaptive simulation studies appears in 
a separate program documentation manual [2]. 
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e°(kK), can then be calculated as the difference 
between y9(k) and the present value of the plant 
output (plus measurement noise). 

5. The program is now able to calculate a value of 
v(k)2, the equivalent identification system state. 
6. Using the adaptation laws of Theorem 523, the 
values of Aj(k) and By(k) (i=1>h, j=1>£) can be 
calculated. 

7. The reference model output, Y(k), is 
calculated from known past values of yevend 
Setpoint values, r. 

Sie y(k), the identification model output, can be 
determined from the updated parameters calculated 
in step 6. 

9. A control error, €(k), is then determined as 
the difference between the reference model Output 
and the identification model output at step 8. 

10. The equivalent control system state at the 


(k+1) &8 instant, v(k+1), is then calculated by 


This is accomplished by using the relation: 
ve a PI p 
w(K) Fe (kh) it 2) De (k-4) 
F s=1 
i=l 
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using equations (18)-(20) of Chapter Five. 

11. The adaptive model closed-loop parameter 
matrices A ip (k+1) and Bp(k+1), G=1>h, j=1> f) 
can be calculated by using the adaptation rules of 
Theorem 5.2. 

12. The desired output at the (k+ 1) 5 instant, 

¥ 3 (k+1), is calculated using the parameter 
matrices determined in step 11. and present and 
past values of y and u. 

13. The control input, u(k), is determined using 
the adaptive inverse approach described in Chapter 
Five (equation (67)). 

14. Step 1. is then iterated upon at the next 
Sampling instant. 


6.5 Simulation Results 


This section will discuss the results obtained using 
the two SISO systems described above. The explanation has 
been divided into two subsections because of the inherent 


differences in the examples chosen. 


The major effects studied included: 
(i) measurement noise; 
(ii) variation in the (constant) outer loop gains; 


(iii) changing the rate of decrease of the 
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magnitude of the identification loop gains; 
(iv) effects of choosing different initial 
identification loop gains and, 


(v) reference model choice. 


A summary of all the SISO runs, presented, appears in 
tables 16.1 and’ G.2. 
6. 5.6.1 System 1 -- 1.75714s+1 [8] 


a) Measurement Noise 


A direct indication of the effect of meaSurement noise 
on the system, can be obtained by examining Figures 6.4 and 
€.5.2 In particular, Figures 6.4(a) and 6.5(a) demonstrate 
the filtering effect that is apparent when the magnitude of 
the identification loop gains are decreased. In both cases, 
the adaptive identification loop is only able to utilize the 
noise ccrrupted measurements shown in Figures 6.4(b) and 
€.5(b). Both these runs were carried out using a very large 
hoise input; the maximum variation being approximately 0.6. 
This represents a noise level of 60% of the final desired 


output. 


Whilst the response is clearly dependent on a number of 
factors, including i , the overall conclusion is that 


decreasing magnitude gains must be used ina noisy 
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environment; if not, an oscillatory response about the 
desired output will result. 


b) Outer Loop Gains 


The outer loop of Figure 6.1 has been included to allow 
some insurance against excessive control action being 
generated as a result of an incorrect driving model 
specification. This loop also guarantees a stable approach 
to the desired output transient. The results depicted in 
Figures 6.3 and 6.6 have been employed to investigate the 
use of the outer loop gains as a means of centrolling the 
rate of approach to the desired output. In both runs, a 


moderate amount of noise filtering was employed (A =10). 


From the responses shown in Figure 6.3(a) and 
Figure 6.6(a), it can be concluded that the outer loop gains 
do not significantly affect the adaptive trajectory. 


c) Effect of Different Reference Models 


The results of Figures 6.5 and 6.8 indicate the effect 
of changing the manner in which the outer adaptive loop is 
excited. It was thought that a very slow reference model 
transient would allow the identification system more time to 
converge and at the same time reduce the effect of large 


control action. However, from the simulation results 
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obtained, there does not seem to be any advantage in 
specifying a reference model with a very large time constant 
relative to the plant, although this May depend, to some 
extent, on the amount of measurement noise present. 

d) Variation of the Rate of Decrease of the Magnitude of the 


Identification Loop Gains 


‘Figures 6.5 and 6.6 show the effects of a change in i 
from 1 to 10. This action is to allow less filtering of the 
noise corrupted plant output measurements for the second 
Simulation run. This step has the expected result, in that 
the actual plant output of Figure 6.6(a) exhibits much more 
oscillation about the desired output level than does the 
response of Figure 6.8(a). 


e) Choice of Initial Identification Loop Gains 


Theoretically, the initial identification loop gains 
may be as large as desired, although it would be expected 
that, because of the initially faster adaptation of the 
identification loop parameters, the actual plant behaviour 
would exhibit a larger deviation from the desired transient 
at the start of the run. Figures 6.5°(a) and 6.7 (a) 
demonstrate this effect. It is also noted that the 
convergence to the desired trajectory is faster when larger 


initial gains are used. The choice, therefore, of these 
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Parameters will depend on how much initial oscillation can 


be borne. 


Finally, Figures 6.9 demonstrate the response obtained 
with a large amount of filtering, small adaptation gains in 
both loops, and a reference model with a large time 
constant. The actual plant output characteristic, 

Figure 6.9(a), demonstrates an oscillatory behaviour, 
although the initial response does not mirror the extreme 
deviaticns of Figure 6.8(a). The converse is true with 
respect to the latter stages of the trajectory where the 
convergence exhibited by the system of run 4 is almost 
complete. 


6.5.2 System, 2uss/ 1615/1 bwtl 


This system injects numerator dynamics into the 
adaptive configuration. The example, therefore, cannot be 
viewed as a simple state-space formulation since, by 
definition, it incorporates incomplete state information. 


a) Measurement Noise 


As with the previous example, the effect of measurement 
noise on this system can be quite dramatic, particularly 
Since previous control inputs are inherently present in the 


System description. Figures 6.11 and 6.12, and Figures 6.16 
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and 6.17 may be compared, respectively. In the first 
response of each set, the trajectory of the actual plant 
output approaches the desired value. However, the second 
responses show unacceptable oscillation abcut the reference 
model output. Although these results are obtained using 
very large noise inputs, the recommendation is clearly 
towards the use of decreasing Magnitude adaptive 
identification gains in the presence of noise corrupted 


measurements, 


Run 1 (Figures 6.10) show the responses obtained 
Without measurement noise being present. The actual plant 
Output depicted an Figure 6.10 (ajymis Tapidly convergent to 
the desired output. 


b) Outer Loop Gains 


It is dubious whether the outer loop gains are a viable 
design parameter for this System, at all. The responses 
Shown in the two sets of runs depicted by Figures 6.11 and 
6.14, and Figures 6.15 and 6.16, respectively, do not show 
any Significant improvement over one another. It can be 
argued that the response of Figure 6.16 (a) shows some 
improvement over that of Figure 6.15(a); however, the outer 
loop gains vary by three orders of magnitude for these runs 


and the effect must be considered, at best, insensitive. 
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c) Variation of the Rate of Decrease of the Magnitude of the 


Identificaticn Loop Gains 


AS with the previous design parameter choice, this 
decision does not seem to be a critical one for, this systen. 
Indeed, the results shown in Figures 6.16 and 6.18 show 
little difference. In Spite of this, the general 
inclination would be to Specify a large filtering action for 
large measurement noise inputs. 


d) Choice of Initial Identificaticn Loop Gains 


Figures 6.13 and 6.15 show the response Characteristics 
when one changes the initial identification loop gains 
tenfold. In general terms, the actual plant output 
characteristic shown in Figure 6.13(a), shows less overshoot 
than does Figure 6.15(a), especially in the initial stages 
of the run. The latter part of the response, however, 
indicates a closer convergence to the desired trajectory for 
Figure 6.15(a). An explanation for this effect can be 
advanced if it is assumed that the adaptive gains behave as 
do normal conventional controller gains, ie. the larger the 
initial gains are, the more oscillatory will be the initial 
Output. At the same time, because of the larger 
identification gains, the tracking of the plant output will 


cccur more quickly and hence, the final convergence will be 
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closer. 


6.6 Summary of the Single-Input Single-Output Results 


The simulation results discussed in the above section 
have demonstrated several effects of the design parameters 


of the hyperstable adaptive control SYSCeCM Of Figure i6.1. 


For the two particular examples discussed, several 
conclusions can be drawn: 
(1) Constant identification loop gains cannot cope with 
noise corrupted measurements and decreasing magnitude gains 
Should be used wherever unfiltered measurement noise is a 
problem. 
(ii) The overall system appears to be quite insensitive to 
the magnitude of the outer adaptation loop gains and these 
are a relatively unimportant design specification. 
(iii) The amount of filtering of noise corrupted 
measurements (as determined by the values of the 
parameters, » ) is important in certain cases. Generally, 
it would be recommended that the amount of filtering action 
used, should reflect the magnitude of noise present in the 
plant output, and, 
(iv) The larger the initial identification loop gains, the 
more oScillatcry will be the initial stages of the plant 


response. Commeasurate with this effect, is that higher 
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initial gains give faster identification and closer 
Subsequent convergence of the plant output to the desired 


value. 


So ome Se oe SS ee Se oe oe —— Se es ewer ae a om ae SS See 


Table 6.3 provides a summary of the multivariable runs 
that are presented in this section!. These runs were 
included to illustrate, primarily, the output driving 
function of the proposed adaptive control scheme. As such, 


they do not represent a definitive simulation study. 


Runs 1 and 5 (Figures 6.23 and 6.25) employ constant 
identificaticn loop gains; the second of the set showing the 
results of control in the face of constraints imposed on the 


plant inputs. 


Runs 2 and 3 (Figures 6.20 and 6.21) show the effect of 
changing the rate of decrease of the magnitude of the 
identification loop gains. A tenfold increase does not seem 
to represent a significant change in the response time of 


the systen. 


For relevant run data not included in Table 6.3 the 
reader is referred to Appendix 6.1. 
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Finally, runs 4 and 7 (Figures 6.22 and 6.25) depict 
the response in the face of noise corrupted measurements. 
The addition of decreasing magnitude identification loop 
gains can be seen to provide an improvement in control with 
respect to that noted in run 6 (Figures 6.24). Run 6 
further demonstrates the dependence of the system on the 
output convergence of the estimation scheme; the oscillatory 
response of the plant output (Figure 6.24(a)) being 
principally due to the identification error variation 


(Figure 6.24(d)). 


General Remarks 
1. The systems investigated have included a state-space 
formulation (System I) as well as two general input-output 
configurations. Thus, the simulations have included the 
incomplete state information case. 
2. The plant models chosen exhibit very large interactions 
and yet it has been possible to drive the outputs towards 
arpitrarily chosen values. 
3. It has been noted that for large noise levels, the 
systems are apt to produce unstable outputs. This is 
thought to be due to the identification model displaying 


non-minimum phase characteristics. A projection feature, 


such as that suggested by Ljung [3], is needed, especially 
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for multivariable systems to protect against this 
eventuality. This would essentially limit the 
identification model parameters to a fixed-space such that 
any combination of parameters results ina minimum phase 
set. Theoretical conditions for output realizability! under 
such circumstances are required. 


6.8 Conclusions 


Altogether a total of five systems have been examined 
in a simulation study to investigate the effect of various 
design parameters on the proposed hyperstable, adaptive 


control scheme. 


The system has been shown to respond very well in the 
face of noise corrupted measurements for both single-input 
Single-output and multi-input multi-output plants and, in 
general, it would be recommmended that the amount of 
filtering action (as determined by the value of A ) be 


tailored to the noise present. 


Some of the multi-input multi-output runs have shown a 


This would refer to the ability of one system to track 
another's outputs when their parameters are not identical. 
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tendency to become unstable in the presence of very noisy 
measurements. The explanation has been advanced that this 
is due to the uncertainty of the manner in which the 
identification model parameters adapt. It is felt that some 
type of projection mechanism may provide a solution to this 
problem. This comment also applies to the scheme put 
forward by Martin-Sanchez {4 - 5], as this difficulty exists 


there, too [ 6]. 


Undeniably, there is an undesirably large amount of 
oscillation during the initial stages of adaptation. This 
relates to the identification process, in that the Gaussian 
excitation input signals, used to drive the initial 
identification sequence, is rich in frequency content but is 
unrelated entirely to the control actions generated in the 
control mode. Because the identification procedure need not 
provide good estimates of the actual plant parameters (the 
only requirement being output convergence), the parameters 
are apt to readapt when excited by a different class of 


input signal. 


Finally, it is noted that the output driving function 
has been shown to be valid under some very stringent 
environmental conditions. Certainly these schemes are far 


more attractive than the essentially regulatory systems 
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investigated by Oliver [7]. 
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CHAPTER SEVEN 
Dynamic Precompensation Using Model Reference Techniques 


Ve bi ontroduction 


ee Swe ee ee a ee oe ee 


The development of multivariable frequency domain 
design techniques, in the last decade, has reversed a trend 
in research institutions that had been prevalent for the 
previous fifteen years. Rijnsdorp and Seborg [1] have shown 
fairly clearly a general reluctance, on the industrial 
world's part, to have anything to do with the so-called 
"modern control" methodology, principally it appears, 


because of the reliance on linear parametric models [2]. 


The frequency domain methods, on the other hand, do not 
strictly require a parametric model as frequency data will 
suffice. Further, these schemes retain the desirable design 
features of the classical single-loop ccntroller 
designs [3,4], 
2es,5 

i) the controllers may be tuned "on line", This 
has obvious ramifications from an industrial 
viewpoint; 

ii) no state estimation is necessary since outputs 
only are used; 


iii) since the gain estimates are conservative, 
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there is a certain safety margin with respect to 
inaccuracy in the data or to drifting parameter 
values. These schemes are, thus, generally less 
sensitive to parameter variations than other 
methods, and 

iv) a very good indication of a number of facets 


of the control scheme, including: 


(a) stability, 
(b) integrity, 
(Cc) interactions and, 


(d) performance are obtained. 


Moreover, classical measures of performance can be 
applicable, giving the designer an en: nous amount of 


subjective choice in configuring the stem. 


Some very detailed work was done =t the University of 
Alberta in the experimental comparison of several promising 
methods, in this area, using a double-effect evaporator [3]. 
Further, a computer-aided design package was developed for 


use on the University's Amdahl 470 V/6 computer [5 - 7]. 


The main objection to these approaches, is the one 


which is held in common with all such apriori design 
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techniques -- the method depends on the relative accuracy of 
the data on which the design is based; data which can 


require extensive effort and cost to obtain.! 


A better philosophical approach would be to require the 
scheme to "learn" on-line the requisite information and 
subsequently adjust itself in some predetermined "optimal" 


fashion. 


The following sections are devoted to describing some 
alternative approaches for implementing the desired 
methodology using model reference techniques. 


7.2 Model Reference Adaptive Decoupling 


The model reference approaches of Chapter Five appear 
to offer an interesting and operable procedure, in 
conjunction with the frequency domain techniques, for the 
implementation of the philosophy described immediately 


above. 


There are essentially two schemes that could be 


An obvious case in point, here, is equipment with 
ill-defined control objectives, such as the indurator 
operated by Hamersley Iron Pty. Ltd. in Dampier (Australia). 
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envisaged, at this time, and they are depicted in Figure 


Tele 


The first of the two proposed methods is similar in 
concept to the example presented in Chapter Five, in which a 
hyperstable identification scheme is used to provide 
estimates of the open-loop plant parameters at each instant. 
These can then be used in any desired manner to update the 
parameters of a controller/compensator. This method, 
although only strictly applicable to stable plants, is the 
more general of the two, as there is included an explicit 
identification that, as such, represents a rich information 
stream which may be tapped in a number of ways. In 
particular, a scheme may be suggested using the results of 


Chapter Five. 
Suppose that: 


Gc EK = ¢ eeeecessceceeceecoscecccaecesrecceceseccecceccecceo( 1) 


OL pre OLg 


where: 

G o, (Zz) is the identified plant transfer matrix at any 
instant. 

ieee) is the decoupling precompensator transfer matrix. 
and, 


Go, (z) is the desired open-loop transfer matrix at any time. 
Gepsina,| 
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ADAPTATION 
ALGORITHM 2 


ADAPTATION 
ALGORITHM 1 


DECOUPLED OR 
"MODEL" PLANT 
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FIGURE 7.1(a) DYNAMIC ADJUSTMENT OF A PRECOMPENSATOR VIA 
THE AUGMENTED OUTPUT MODEL REFERENCE ADAPTIVE 
CONTROL METHOD 
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ans 
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ALGORITHM 
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FIGURE 7.1(b) DYNAMIC ADJUSTMENT OF A PRECOMPENSATOR VIA 
THE DIRECT PARAMETER ADJUSTMENT MODEL 
REFERENCE ADAPTIVE TECHNIQUE 
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By Simple rearrangement of equation (1), one has: 


G e140 wie a wide) a elera aie eles enerale € e's ene ee 00 600.0 eto ) 


= g 1 
= OL OL, 


pre 


a 


The requirement that Go, be invertible implies two 


further conditions: 


(1) that there be no adaptive right-hand plane 
zeroes present and thus, the identification model 
Should be minimum phase and, 

(11) the number of outputs must equal the number 


of inputs. 


A related strategy to the above, involves the use of a 
Signal-synthesis approach similar to that outlined in 


Chapter Four. 


Suppose that D,(z)=0 in Figure 7.1(a). Also let bag be 
the desired output at the next instant and, it 


Then, from Figure 7.1(a): 


; = : = @. 010.4 61008 4 Oe alece stele e Sue 61 e eie.e e.ele ce e156 eee ele ee ar) 
iv Go, ¥ Y 


This equation may also be written in the time-domain as: 
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where y(k-i) and u(k-j) are n dimensional identification 
model output and control or input vectors, respecively. 


A a 


A, and B, are identification model parameter matrices of 


appropriate order. 


Rearranging equation (4), one arrives at: 
isa 2 


Ame) Cin — 62 te dy 
ak 


ui(k) = By?(k df ¥ Ck tol) = 
i=] 


iE 
2 BrCk) yk = 35 + 1) J Coevoeererecececces ce esececcseceosce el 5} 
gee i 


Since the control signal, to be applied to the plant 


via the primary fixed control loop, can be written as: 


Mo =~ K CZ, 1o.0 016 6.6 6.0 010 6 610.6 0.0 €.4. 014 6.010 41014106 410 6 0 6 401016416116) 


pre 


then, utilizing equations (5) and (6), the supplementary 


control signal may be computed from: 


u*(k) = uayi(k) <i u2(k) Rig a een e eis ee elalealatele' a) elele7s eve evejesiace e160 7.) 
The second technique (that depicted in Figure 7.1(hb)) 
has been considered by Bethoux and Courtiol [8] for the 


general control situation. 
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It is supposed that the plant can be represented by an 


expression of the form: 


x(k) 


i 
he 


x(k - 1) + Bulk - 1) 


and: 


v(k) 


id x(k) COCCOSTOE CCH CH ECOEC COC EET OCR Ce TEC Descececaccsel &) 


where x(k) and y(k) are n dimensional vectors 
u(k-1) is an m dimensional input or control vector and, 


bs and Bb, are process parameter matrices of appropriate 


order. 
A control law can be defined as: 
u(k) = -K (xk) y(k) + & (kk) v(k ) @cecececccesecccccccaec( G) 
FB pre 


K pp (k) and Kop {k) are time-varying feedback and 


precompensator matrices, respectively. 


Substituting equation (9) into equation (8), one has: 


— = - + =- 
vor) U= 4, By Epp) TexCKi~) 4) E , Bore 6 *? Vi =) 1) 


pinlate G biele.o 610.6 0116.01.00 4. © 1070101016 6 6.6) 616166 0,0618)6 010/016 le lele el alerere:s eCity) 


A decoupled model reference plant is now specified as: 
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= cag? te rat @eec7aeeeeeeneeceevede ek i 
yb) ence 0 Bev Ck 1) (11) 
where y.(k) is an nx1 model output vector. 

v(k-1) is an nx1 model input vector and, 


A, and Bare diagonal model parameter matrices of 


appropriate order. 


Defining an error vector,€(k), as: 


E€(k) — x bk) ad y(k) cede alee ae ee aula 6 élelee o cided 6466 406 06 00 12) 
and: 
Pa 
otk) = > BAH OS Gat? 
i=o 
Defeated & 


diane ielerelerelerte ale alerelelalererateleleleielel elererere etetelereleverereieserelerelateiG con) 
where equation (13) defines the input-output relationship of 
a linear compensator, D(z), one can derive, using 


equations (8) - (12): 


= - Me = te (k)) kena 1 + 
E(k) 4 E(k 1) (A. 4, B. Bop y( ) 
(B ere =| K (k )) v(k - 1) ececcecesaseccesnccccvccccsocvecee( 14) 
m Pp pte 
Letting: 
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B = b Bo eeoecceesecrecececeesresescececeececencanccececcesccccee( 15) 
m 


equation (14) becomes: 


Gi) = 4 £tk =p) + Bil (Ao + Epp tk) yl A+ 


( a (k«)) ie @eeeeeceoeovneneeeeves 
Bo aie v( 1) ] @ececeoceecsece( 16) 


Now lets: 


w(k) = (Ao + FE. (k)) vik = 1) + (Bo - E (k)) wk - 1) 
FB pre 


CC oe Se EE COLE SCE FCCC HREOC ECE SCO CC EE COC EEE AOL EL oCoeCCeCLCeeceecece( tT J 


and: 


wyiCk) = —w(k) Cece sesarcccccececccccccccccvcccseseecseee( 18) 


Thus: 


2(k) = A €(k - 1) + B w(k) siateleiaivieie eetelele 6.¢ cee « eisle eest Lo.) 
m Pp 


Now, we further restrict the system description space 
to those trajectcries upon which the vector pairs (n, wy) 


satisfy the following inequality condition: 
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Ky 
POo gh s on den Ck) Wilk) 2 =. 246 
k=ko 
Vky > Ko @ecececevececececcesce2ecccscccecase( 20) 
where i, is a finite constant, only dependent on the 


initial state of the systen. 


Equations (16) - (19) and inequality (20) define a 


system which can be depicted as in Figure 7.2. 


It is cbvious, therefore, from the previous 
development, that the discrete hyperstability theorem [9] 
may be invoked once more to obtain adaptation laws for the 


and K or matrices. This leads to the following theoren. 


Sufficient conditions for the adaptive decoupling 
system described by equations (8) - (9), (11) - (13), 
(17) - (18) and inequality (20) to be asymptotic hyperstable 


ares 


(i) The transfer matrix, G(z), defined by: 


GGz) = "9 LCz) Cia 4, ra i B 


must be positive real discrete; 
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FIGURE 7.2 EQUIVALENT AUTONOMOUS NONLINEAR FEEDBACK SYSTEM 
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and n(k) must all be of the same dimension and, 


(iii) the adaptation laws for K pp Ck) and K pre (kK) 


must admit the following nonlinear functions! 
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1=ko 
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A (x) = BUC Wl AG vt ht) yee 
1l=ko 


Re and gtare positive definite or semi-definite 


matrices. 


The first condition of the Theorem can be shown to be 
sufficient by using Theorem 5.1 and the equivalent system of 


Figure 7.2. 


Only “integral adaptation" [8] has been considered 
here, as the proportional term may be considered as a simple 
extension. 
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From the discrete hyperstability theorem it is 
sufficient, for the system of Figure 7.2 to be asymptotic 


hyperstable, that: 


(1) G(z) must be positive real discrete and, 
(ii) an inequality of the form cf (20) must be 


Satisfied. 


From equation (19), one obtains: 


Erez = Cit aa aa i eeveveceaesea 
arn 2 wz) eeeceecesescecccececc ee e( 21 


Or using equation (13): 


nez) = pt(z) Ole = =A Zmtey lB WOZ)) eis oe wie 0 416 6100 e0le'e 6 .0( 22) 
m Pp 
Somcnd ts 
GUzZ) =) DCzZ IT Gly irae ae 
m Pp 
and condition (i) of the theorem is thus froved. 


The second condition merely ensures that w(k) and 
hence, w ,(k), are defined and the product y1(k)w,(k) is 


sensible. 


It thus remains to show that the adaptation laws, 


characterized by condition (iii) of the theorem, ensures an 
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inequality of the type (20) is verified. 


Utilizing equations (17) and (18), (20) becomes: 
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Introducing the adaptation laws of the theorem: 
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Sufficient conditions for inequality (24) to be 
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a pk . a uk 
L n €k) [ (Gere nCL EO v(t - 1) J - Bo Fowek = ab) 
k=ko 1=Ko 


Vkgit>-ic6 Tape eeu itale everaleieiaisisisvalepsjene Ciao) 


These conditions can be verified by noting the 
property [8,9]: 
ky k 
ilk ak 
So ck [ ss bap + Fo >= 2 Fo Fo Be ede, Ue teice levetere loners eee On) 
k=ko k i=kp - 
This proves Theorem 7.1. 


Remarks 


At each instant, one needs to calculate K pp (k #1) and 
Cet) Unfortunately, these are functions of the, as 
yet, unknown y(kt+1). From equations (12) and (13): 
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using equations (10) and (11). 


Introducing the adaptation laws in equation (28), one 
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Rearranging equation (31), we obtain: 
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A major difficulty arises for the practical 
implementation of equation (32), ie. a complete knowledge of 


the process parameter matrices is strictly required. 
In order tc minimize these difficulties, two 
assumptions are made [8]: 
(i) the estimated performance error vector: 
eet py Cth ak ae SAI VRE rara orate ots cleus ee elsiaieiatere (ca GD 
can be approximated by ¢°(k), where: 
vO 1 = if 4, ~ B, Erp? J v(x) + B, BoC v(k) (34) 
(ii) the setpoint changes, r(k), must be known one 


sampling instant ahead. 
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The second assumption merely ensures that yv(k) can be always 


made available. Thus, for practical applications: 
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provided (I + B (Ry (K)) ¥(k) + (Qu(k)) ¥(k))) is always 
invertible where Bg is chosen such that it falls within the 
range of the variation of Bae 


7.3 Conclusions 


Much of the original model reference adaptive control 
work has been directed to forcing a system to follow any 
desired trajectcry. Whilst this certainly is a worthwhile 
objective, in many cases it simply is not feasible to 
specify an arbitrary reference model. Because of the 
enormous investment in apriori design techniques and the 
number of methods available, it would appear that a more 
sensible approach would be to use the adaptive mechanism to 
correct the designed controllers under changing process 


conditions, etc. 


This procedure supplies two desirable aspects: 


(i) the configuration yields a two-level control 
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technique which is essentially able to "learn" how 
to cope with its environment "on-line", but with 
the added integrity of a primary control loop and, 
(ii) all the process knowledge which goes into the 
design of the primary control system becomes 


availabie for the adaptive loop design. 


This chapter has introduced methods for dynamic 
precompensation of a plant when sufficient knowledge is 
available to design controllers based on multivariable 
frequency domain techniques. The methods have been based on 
hyperstable adaptive systems, developed previously, purely 


for control purposes. 


It is manifest that this concept is infinitely 
extendable, in theory, since the reference model is 
arbitrarily specified and could include some sort of 


directed logic supervisory mode [10 - 11]. 
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CHAPTER EIGHT 
Conclusions 


8.1 Introduction 


The prime motivation for this work was the desire to 
classify the field of model reference adaptive control. 
Although there are several excellent surveys 
available [1 - 7], these have been concerned primarily with 
indicating the various aspects of the design work, rather 


than the similarities inherent in the schemes presented. 


Further, there was felt to be a need to conceptually 
re-examine the results of the last decade to gain some 
insight into which direction it would be most profitable to 


venture in the future. 


Of the two model reference design methods based on 
stability techniques -- the Liapunov technigue [8] and 
schemes based on Popov's hyperstability theory E9= 0104, the 
latter appears to be the nore promising [1,10:> 11]. The 
schemes investigated from Chapter Three on, have restricted 


themselves to this basis. 


In the last few years there has been a general 
re-evaluation of the state-space control theory, 


particularly in response to several practical objections 
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that have been raised [12 - 15]. This has resulted in a 
more careful examination of input-output type relations and 
their usefulness in design. Not only have transfer function 
techniques been extended to incorporate multivariable 
systems [16 - 19], but the state-space theory, itself, is 
being developed to consider more techniques based on output 


(or incomplete state) feedback [20 - 25}. 


Conceptually the requirement at the present time 
appears to be the following; based on input-output 
measurements of an unknown plant, design an adaptive system 
which will guarantee the control objectives of the entire 
controlled configuration. Since the fixed parameter 
techniques are essentially special cases of the adaptive 
control superset, it is not surprising that work in this 


direction is being considered by adaptive system designers. 


Martin-Sanchez [26 - 27] appears to have been the ELESst 
to consider a specific design technique to satisfy the above 
requirement, although the claimed general applicability is 


questionable [28]. 


This werk has considered a very general theoretical 
presentation of the adaptive problem, with specific 


reference to the design of a technique similar to the one 
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proposed by Martin-Sanchez, although starting from the 
theory presented by Landau [10 - 11]. The validity of the 
method has further been tested by a simulation study and 
several suggestions as to practical calculational procedures 
have been included. Moreover, since this scheme is 
essentially dependent on the estimation system convergence, 


the results of Ljung [29] have been mentioned. 


It will be noted that regulation per se is not of 
principle ccncern here, as it is a subset of the output 
driving problem. There are some cases, however, in which 
regulation can be a prime goal. In such cases the 
adaptation mechanism can be more profitably employed in 
updating conventional controllers. This may take place 
intermittently, avoiding the problem of large computational 
overheads. Of particular interest is the so-called dynamic 
precompensation approach, in which an adaptation scheme is 
responsible for updating a precompensator, which in turn 
maintains a particular system feature (eg. diagonal 
dominance). The primary control task is meanwhile achieved 


by a fixed parameter controller. 


The following sections are concerned with summarizing 
the cognitive categorizations of the model reference 


adaptive approaches mentioned in the previous chapters. A 
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brief note towards the end of the chapter will examine 
possible modifications of existing state-space methods to 
include incomplete state feedback without the use of 
observers. 


8.2 Model Reference Adaptive Control System Definition 


Conceptually all model reference adaptive control 
techniques belong to one of two classes. The first, ofthese 
includes a mechanism whereby the parameters of the 
controller, itself, are adjusted directly. fhe controller 
is contained within a conventional control configuraticn and 
control action is exercised through this primary loop. 
Whilst this approach might seem very attractive, there 
appears to be several limitations for general implementation 
purposes. For example, these schemes are restricted to 
formulations of relative degree one with some known apriori 
information about the variation of the plant parameters 


assumed [{ 30,41-43]. 


The second cognitive approach relies on a recursive 
estimation scheme to supply an updated estimate of the 
open-loop plant parameters. The parameter set may then be 
used to compute the control action required, in any 
convenient manner. This method may be termed an indirect 


technique as achievement of the control objective is 
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dependent on the output convergence of the estimation 


scheme. 


These two classes of adaptive control system are 
depicted in Figures 8.1 and 8.2, respectively. It should be 
noted that in these diagrams, the reference model per se has 
given way to what has been termed a driver DLOCK 26 Jami nis 
approach has been taken so that it is realized that the 
poner cca model need not be an accurate representation of 
the plant. The main criterion for a good driver block 
design is that it properly designates the desired output of 
the systen. 


8.3 Practical Adaptive Control System Definitions 


This thesis has considered the theoretical development 
of practical schemes based on both the classes of control 
system depicted in Figures 8.1 and 8.2. Figures 8.3 through 
8.6 schematically represent four general configurations of 


adaptive system. 


This particular demarkation summarizes the schemes that 
have been suggested to date. None are perfectly general, 
although all may be considered as a subset of one of the 


designs presented in Figures Sc37 Ome. 66 
There appears to have been a Strict. d2viston in che 
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literature between those schemes which utilize an 
input-output formulation as their starting point, and those 
which are based on a state-space methodology. For instance, 
the systems depicted in Figures 8.3 and 8.4, usually require 
an input-output description to be used, whereas those of 
Figures 8.5 and 8.6 are strictly state-space techniques. 

The decision is based on mathematical tractability 
considerations, for at present, the only general method for 
calculating the control signal using the approaches of 
Figures 8.3 and 8.4, relies on an adaptive inverse 26g 5.0] 


computation. 


The state-space methods are not so restricted, although 
if true incomplete state feedback is considered an on-line 


minimal realization routine may be required}. 


The next section will summarize the design freedom and 
theoretical restrictions of each of the general control 


schemeSe 


See Section 8.5. 
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A GENERAL MODEL REFERENCE ADAPTIVE CONTROL 
SYSTEM BASED ON PRIOR IDENTIFICATION 
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FIGURE 8.4 MARTIN-SANCHEZ'S ADAPTIVE-PREDICTIVE CONTROL 
SYSTEM [26] 
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The discussion may be organized intc three distinct 
subdivisions: 
(i) Input-Output Methods Based on Prior Lédentification <7 
represented by the techniques of Figures 8, 3"and 8.4, 
(ii) State-Space Methods with Direct Adaptation of the 
Controller Parameters. Figure 8.5 represents these methods, 
and, 
(iii) State-Space Methods Based on Prior, Ldentification,, as 


represented by Figure 8.6. 


(i) Input-Output Methods Based on Prior Identification 


Figures 8.3 and 8.4 conceptually describe the most 
promising adaptive control schemes that can be envisioned, 
since they are by definition based solely on input-output 
measurements of the plant, asymptotically stable and 
absolutely convergent to the desired system state. Due to 
mathematical tractability conditions, however, there are 
several practical restrictions which must be accepted. 


a) Compensator Design 
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In the particular example of the design presented in 
Chapter Five, a compensator was introduced which ensured the 


positive realness of a linear transfer matrix! [11,33 ]- 


Tt is unclear in what way the compensator order affects 
the performance of the control system, although obviously if 
unstable plant poles are known exactly, these may be 
cancelled by corresponding zeroes of the identification 
model’ compensator. 


b) Identification Scheme 


In both the methods shown in Figures 8.3 and 8.4, the 
convergence of the control system is based on the 
convergence of an estimation scheme, Thus, theoretically, 
any asymptotically convergent jdentification technique which 
can be operated recursively can be used. For instance, any 
of the following are obvious candidates For such vas chonce. 

1. Hyperstable Recursive Identification [ 34], 
2. Extended Least Squares [35], 

3. Instrumental Variables [36], 

4. Recursive Maximum Likelihood { 29] and, 


5. Extended Kalman Falter. tov). 


Seeucnapter Five -— Section 523. 
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In all of these there is a requirement that in the 
absence of any exact knowledge of the plant parameters, the 


plant must be open-loop stable 29) 


Because of the manner in which the control action is 
computed, there is a certain freedom of adaptation in that, 
strictly, parameter convergence is net necessary; the only 
requirement being that the output error between the plant 
and the identification model go to zero. This alleviates 
the problem which faces all identification techniques when 
embedded in a closed-loop control configuration ie. the 
requisite "richness" of the input signals is seldom 
sufficient for accurate parameter identification in a 
closed-loop envircnmente 


c) Control Computation 


At present, there is only one method available for the 
calculation of the input signal based on desired output 
information and the identification model parameters -- the 
adaptive inverse approach. In both its forms: 


4. Controller Transfer Matrix Computation and, 


See Chapter Five. 
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\eeDivecthcontrol/Signalscatculation, 
there is a distinct difficulty with identification models 
which contain right-half plane zeroes! [28]. This problem 
arises during the calculation of the control signal because 
the algorithm uses the inverse of the identification model. 
Hence the right-half plane zeroes become right-half plane 
poles and the consequent control action becomes unstable. 
The difficulty is more readily recognized when it is 
remembered that the identification scheme is only required 
to facilitate output convergence and the parameters may be 
adaptively placed anywhere in the parameter Space. 
Martin-Sanchez has suggested that this problem does not 
present any problems since the driver block (reference 
model) can be chosen such that the situation never 
arises [38]. This is difficult to rationalize since the 
schemes do not place any restrictions on the parameter 
placement. A more general solution would entail the 
specification of a specific parameter Space which is known 
to be minimum-phase for all parameter sets. The prime 


consideration then would be the question of output 


Here the w-plane is considered, as this representation 
is more familiar to practising engineers. 
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realizability ie. the ability of one system to follow 
another eventhough their parameters are not identical. 


ad) Driver Block or Reference Model Specification 


Whilst this choice is to all intentional purposes 
completely arbitrary, it would normally be expected that the 
specification would realize a stable and physically 


meaningful desired output signal. 


(ii) State-Space Methods with Direct Adaptation of the 


Controller Parameters (Figure 8.5) 


These schemes are restricted to completely observable 
and controllable systems where ail the states are 
accessible. 


a) Compensator Design 


The specification of a compensator ensures the positive 
realness of a certain linear transfer matrix [30]. In this 
case some of the plant parameters must be known, at least 
approximately, so an additional requirement is that the 
transfer matrix be positive real over the entire range of 
the plant parameter variation space. Karmarkar [39 - 40] 


has presented a scheme for designing compensators to ensure 
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this property. 


There appear to be no restrictions on the open-loop 
plant configuration in these techniques, although the 
reference model would normally be assumed to be stable. 


b) Control Calculation 


The control action is calculated using an updated 
controller. At present the control law is restricted to the 


form: 


RS ~Epp x 7 K cp ne + Kop el eM te et eta telele sistetereieo e616 ore. bid 


where u is an mx1 control input vector, 
x and £ are nx1 state and setpoint vectors, 
respectively, 
& is a px1 measurable disturbance vector, 


K eB 


K sp 


Kor 


is ar mxn feedback control matrix, 
is an mxn setpoint control matrix, and 
is an mxp feedforward control matrix. 


Notes 


The original theory for this type of system was 
developed by Bethoux and GCourtiol i320 qrfortatpurely 
state-space formulation. Recently it has been shown 


that extensions to include input-output formulations 
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Whilst for implementation purposes these 
techniques have a number of advantages, they are at 
present restricted to: 

(i) plants with uni-signed B ip Matrices «(2.e.) call 

the elements of a particular Bip matrix are of the 
same sign) [41 - 43} and, 


(ii) input-output formulations of relative degree 


one [41 - 43]. 


The extension due to Johnstone [41] does not require 
that all the elements of the Bip's be of the same sign, 
although the compensator design would require some knowledge 


of the variation of these parameters. 


(111i) State-Space Methods Based on Prior 


Identification (Figure 8.6) 


This approach may almost be termed the 
"classical" approach to control law parameter 
adaptation as there are a large number of procedures 


which are intuitively similar [44 - 46]. 
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Two methods may be envisaged using the 
hyperstable system approach: 

1. hyperstable identification with all states 
accessible followed by controller calculation 
based on the identified model, or 

2e hyperstable identification using only 
input-output data followed by a minimal 
realization routine (32] to obtain an equivalent 
state-space representation. The controller 
calculation would then be based on this 


information as with 1., above. 


The result of both is the same, state-space 
representations of the identified plant. The control may 
then be calculated using any of the available state-space 
design techniques.? 


a) Compensator Design 


Here, aS with the pure input-output methods, it is a 
general requirement that, in the absence of any 


knowledge of the plant parameters, the open-loop plant must 


A particular example is described in the next section. 
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be stable. The compensator is specified such that a 
particular linear transfer matrix is positive real. 


b) Identification Scheme 


The estimation scheme can be any of a number of methods 
(see above) provided it is asymptotically stable and 
absolutely output convergent. Once again there is no 
requirement here for exact parameter matching. 


c) Control Calculation 


The choice of the control calculation technigue is 
influenced by the form of the reference model or driver 
block specification. There are two ways of defining a 
desired output: 

1. as the output of a reference model (or driver 
bwOCK).,) Or 
2e through the description of the reference model 


itself (ie. eigenvalue placement, etc.). 


Whilst the first category requires the least 
computational overheads, the second is inherently the more 
flexible as it includes the whole gambit of state-space 
design techniques from optimal methods through to such 
techniques as eigenvalue placement [47 - 50]. More 


recently, these have been extended to include output 
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feedback and output derivative feedback [20 - 25]. 


d) Driver Block or Reference Model Specification 


Here, as has been mentioned above, it is possible to 
specify the driver block in a number of ways. The control 
system convergence is then dependent on the estimation 
scheme convergence plus the controller design. 


8.5 A Particular Example of a Stat 


Space Method With 


Prior Identification 


This example is illustrative of class (iii) of the 
systems described in the previous section. The primary 
control loop is based on output feedback and the 
identification scheme used is the the input-output version 
of Landau's hyperstable recursive technique [34] described 
in Chapter Five. The reference model specification consists 


of an eigenvalue placement decision. 


A pictorial representation of the system appears in 


Figure 8.7. 


In a recent paper, Paraskevopoulos [51] has presented 
two techniques for solving the problem of pole assignment 


via proportional plus derivative output feedback. 


The controller is specified as: 
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OPEN-LOOP 


PLANT 


td > 


ADAPTATION 
ALGORITHM 


CONTROLLER 


MINIMAL 
PARAMETER REALIZATION 
ROUTINE 


CALCULATION 


DESIRED 
LOSED-LOOP PLANT 
EIGENVALUES 


FIGURE 8.7 EXAMPLE OF A STATE-SPACE METHOD OF ADAPTIVE 
CONTROL BASED ON PRIOR IDENTIFICATION 
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2 = ie Vs a D xX eeceeceseececeeseecceccececcseecsce cece see eeceeccel( 2) 


where u is the mx1 control vector, 


y and y are nx1 output and derivative output vectors, 


respectively, 


|" 


and D are mxn controller parameter matrices. 


The control algorithm for the adaptive configuration of 


Figure 8.7 can be briefly described as follows. 


Suppose that the output of the minimal realization 


block of the Figure can be described as: 


SE ye ies <a = Ra 


Y= C A aieid 6.6.6 6.0.0.6, 6 6 66 O1ele 10.6 6 a) 610s s101676 61 e%e' G10 (ee 16/0) 6.056616 e170 6retco.) 


where denotes nx1 equivalent model “state" vectors, 


x 
y is the rx1 identification model output vector and, 
A, B and C are equivalent state-space identification 


model parameter matrices. 


Using equations (2) and (3), one may write: 


“nw 
a “a 


x = CL ae B D C:) 2 CA oF B y ad ¢) x = a. x ececesccecccecesel( 4S) 


“aw nan 


provided (I - BDC) is invertible. 
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Let H be an nxn matrix with exactly known eigenvalues 
(H can be upper triangular or in phase canonical form). A 


sufficient condition for pole assignment then is to have: 
A = 4H COO00 00 GDOOBOO CS A505 5505656 6666660056 85950666650 5606056556608) 
or det (sI - A.) =det (sI pall Ps 


From equations (4) and (5): 


a “A aA “a 


E Aa c ee B D ¢ H = H eE. A eCoeerccecceecescccceossecececccseese( 6) 


If the following definitions are allowed: 


then: 


E K = Vv we bine Ge 6 66 60 6 0 6076'S. U6 410 @ 016 616 016 016 616.0 0616 0161610 6.0 6 64 7) 


where R=M’* B and * represents the Kronecker product 
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Fo and ait rows of K and V, respectively. 


K ; and v; are l 


Equation (7) may then be solved for K, and P and D 


subsequently determined. 


The computation overheads for this scheme are quite 
significant and so it would be recommended that such a 
scheme is useful mainly for adaptation of slowly varying 


systems in a regulatory environment. 


Since this work has been mainly exploratory in nature, 
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there is a requirement for a future commitment to several 


areas of research. 


Specifically, there is an urgent demand for controller 
design techniques which are based on input-cutput 
descriptions of the open-loop plant. This would allow the 
full flexibility of the hyperstable input-output 
identification schemes to be employed. At present these 
methods are restricted to adaptive inverse approaches which: 

a) can require large and sudden control inputs to 
be stipulated and, 

b) result in unstable centrollers when right-half 
plane zeroes are present in the identification 


model. 


The methods described herein all require a fairly large 
computational overhead to be borne. Whilst the software 
does exist tc carry out these calculational tasks, it is 
often wasteful in time and storage. Algorithms to reduce 
both these factors are available [52] and further work in 


this area would be helpful. 


As far as the author can ascertain, there has been no 
attempt to investigate the use of adaptation techniques 


outside the ill-defined regions of so-called regulatory 
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control or output driving. There are a large number of 
practical situations in which the conceptual notions of 
adaptation could prove beneficial. This thesis has 


mentioned one. 


In relation to the hyperstable schemes examined, there 
is a need to investigate the use of the ccmpensator, D(z). 
For the present it remains as a necessity to ensure the 
positive realness of a particular transfer matrix. Its 
effect on the performance of the system is unknown. There 
is a further problem with the adaptively placed 
identification model parameters ie. right-half plane 
identificaticn model zeroes can result in unstable control 
inputs. A solution based on limiting the identification 
model parameter space to a compact subset of the open 
left-half complex plane has been suggested. The mechanism 
of this procedure and the effect on the output realizability 


of the control system remain to be defined. 


Of a more prosaic nature are requirements for 
experimental evaluation of the various schemes. These would 
be envisaged as directed towards the design choices which 
must be made apriori to the application eg. adaptation 


gains, initial model parameters, etce 
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Be 7 Conclusions 


SD ee ee ee Se ee a Se ee eee 


This chapter has attempted to unify the conceptual 
notions that have appeared in the remainder of the thesis. 
It has been stated that ail model reference adaptation 
methods are subclasses of two general approaches: 

1. Direct adaptive control schemes based on direct 
adaptation of the parameters of a conventional controller, 
and, 

2e Indirect adaptive control schemes based on an identified 


model of the open-loop plant. 


Of specific interest has been the second class and 
various schemes have been mentioned, both within an 
input-output descriptive plane and based on familiar 


state-space methodology. 


The design freedom and restrictions demanded for 
mathematical tractability have been outlined and suggestions 


for future research to complete the study, mentioned. 


Throughout much of this thesis there has been a need to 
remain very specific to certain penenes The bias has been 
firmly entrenched in the input-output formulation, although 
state-space methodology may allow a more acceptable solution 


in the short-term. 
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APPENDIX 5.1 
A Practical Calculational Procedure for the Implementation 
of the Augmented Output Technique for Model Reference 


Adaptive Control 


For the general case of the algorithm, described in 
Chapter Five, it is required to compute two 


compensator/controllers such that: 


Ki(z) = SOL (z) Ei(z) (I a Re Cz) yet ecccesescceccccsec( il) 


and: 


“A 


Thay ¢ » ¢ rau ( ) ( ») ( eee Jileeceeie 2) 
£oOL z i Sor z) Eilz Re (z g z 


Ke(z) 


OL, uSing equation (1): 
Ko(z) = Gat (2) CL + Bi(z) CL - Bi(2)4) Belz) - @ (2) 03) 


Here, the possibilities of measurable disturbances (or 
alternatively disturbance prediction) has been allowed for 


(see Appendix 5.2). 
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G the estimate of the open-loop transfer matrix is 


1a 


given by: 
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G = Cr.= y 4 («) zt y71 » A Pane rateralelere sietera’e Cit) 
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Ge the estimate of the load transfer matrix is given by: 


G Wt ee D.C k) Ze eccecoecccceces( 5) 


h 
y 
oi 


g 
Ap Gkaeie Ajman AF 
1 
} 1= 


The closed-loop transfer matrices, R (2) and RO) can 


be represented, at any time, by: 


H F 
Kki(z) = Cie 2 AY zo it)y73 yi ioe z J eecececcecccecvec( 6) 
fede ie eilecds 
and: 
H G 
Ce BGT 
—_ -_ i 1 @ee@e0eeeéees8kee43#esdé€ 
Eo2(z) (I x 455 Zz y » Qin z (7) 
i=l 1=1 
Ae Ba, 7anG Hee time-varying estimates of the open-loop 
ay =e = 4 


parameter matrices. 
Rue, Da ye and, D6 are timervaryang estimates (of the 
wep) dP ALD 
closed-loop parameter matrices. 

The problem of computation of these quantities, though 
not as horrendous as it first appears, since Bes and a are 
all diagonal, is still quite formidable. 


To see what approximations may be desirable, let us 


This condition is simply a ramification of the 
independence cf the outputs on one another. 
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consider equation (1) first. 


Equation (1) may be written as: 
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Thus, in. crder to calculate K (2). directiyiin this 
manner there would be a requirement that X(z) and (I - Y¥(z)) 


be invertible. 


Suppose, however, that use is made of the control 


configuration. So that: 


Di = Ki e Be a a aigiel arate ane aieleial Gin eherereneieraloterate wie tereie @ 6's 076 e's ejevece(, 
Substituting equation (8) in (9) yields: 

Oy Ss pa 4 Oz wi yy! e Selelejala ele ele we eles 406 ¢.6\e «01660 «0.4 ¥he0 LC) 

Ors: 


S A tee ab & Vid a x)? A= a B10 6 4.0 e1ele ¢ 6/04 610167066 610 @ete 6.40 0.0.6 6.100 LL) 


which eliminates one of the on-line matrix polynomial 
inversions. The online computation is still formidable, 


however, for large systems. 


The next simplification is to assume that the eat are 
diagonal. This corresponds to the case in which the 
closed-loop plant is assumed to respond as a number of 


single-input single-output systems. The reference model 
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would thus, also, be assumed to be non-interactive!. KX 
takes on a special significance, in such circumstances, as 
it is now apparent that it is acting as a combined 


decoupler/ccntroller. 
With this assumption, we may again write: 
Ke Cz) eh? G2) X¥G2Z) Cl - Fy 2 
Or equivalently: 
XO20) aa, = Lh (20 GP ey zr Pe 


where, this time: 
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This approach would seem to be a most attractive one, 
in practice, for the familiar indices of performance could 
be applied to the plant in the classical way. 
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X(Z),is as before. 


Considering equation (10) and the forms of X(z) and 


¥(z), we can write after some algebraic manipulation, that: 
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h 
z j = (1 - yi & imjj z iy C5); Dimjj z 1) eeoe( 14) 
a 


Equation (12) can be written in the input-output 


formulation as: 


Pre (eee 
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Now, at each sampling instant, it is required to 
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cpm 


where the numbers in brackets refer to the element of the 


Matrix and x, 


(16). 


is given by the right-hand side of equation 


Finally, the controls may be computed fron: 
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Or: 
uCk) = Dt > Ceoeeoeecececccecececeoceconececeesnececnceeeceoececeece( 18) 


It must be stated that the analysis, here, assumes a 
square, Opem-Loop transfer matrix.-if this, is not, the, case; 
a Moore-Penrose generalized inverse may suffice, although 
the effects of this approximation on the stability of the 


overall system, has been shown to be undesirable [39 - 40]}!. 


An adhoc solution, to the problem of non-sguare plants, 


is discussed below. 


The computation of K, (2). via equation (3), may be 
considered in an identical manner to the above with R,(z) as 


a diagonal matrix. 


So. cha ©s 
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TCZ)A= RoCz) 


Now, ifs: 


then: 


a a 


Sor uo = Eh a eS rE es aD OO ORR Onin hes) 


and’ thus a control law may be again written as a function of 


the parameter estimates. 


Equation (20) defines an adaptive feedforward 
controller/compensator and, as such, makes use of the 
measurable disturbances in an active manner. 


The Problem of Non-Square Plants 


It has been implicitly assumed in the designs, 
outlined, that the open-loop plant transfer matrix estimate, 


a 


G 


oon is square. This corresponds to a case in which the 


humber of inputs is equal to the number of cutputs. In a few 
Situations, however, this is not the case and provision must 


be made for this. 


Use is made of a fixed precompensator similar in 
concept to those designed, by Kuon, via the DNA method 


[52 - 53], although here, the major criterion of performance 
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is that the augmented plant is stable and square!. 


The scheme is then implemented, as before, using the 
augmented plant in place of the original plant. Figure 
A5-1.1 also includes an explicit identificaticn loop, since 


it is felt that this is a desirable information block. 


The question of stability implies that an approximate 
knowledge of the open-loop poles is available. 
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APPENDIX 5.2 
Effect of Disturbances (Measurable or Not) and Bounded 
Nonlinearities on the Hyperstability of the Augmented Output 


Method for Model Reference Adaptive Control 


All the derivations and proofs, of Chapter Five, have 
ignored the possibility of unmeasureable signals entering 
the system. The adaptation algorithms have no information 
concerning these disturbances, whatsoever. It is, therefore, 
of paramount importance to analyse the system and establish 


criteria which guarantee asymptotic hyperstability, under 


these conditions: 
(i) The Identification System 


The plant is assumed to obey an equation of the forn: 
h 


£ 
y(k) = Yeats vyOCkK = "4 ) + é B; Ck — tie 


i=l j 


& 
My Di E(k - t) + 2 Bi EtGk = v) eccccceccecsccececcose( 1) 
1=1 1= 


Here, 
yrisanrnxt-outpuite vector, 


u is an mx? control or input vector? 
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€ is a px1 disturbance vector, which is known, Vk; 

and, 

£* denotes an ex1 unmeasurable, disturbance vector, which is 
assumed bounded, Vk. 

Aaa Bie Die and D,*' are process parameter matrices of 


appropriate order?!. 


An estimation model can be described by: 
h f 


y(k) = 2 A, (kK) y(k - i) + oY Bk) mGk w=) 5) or 
i=1 j=l 


& 
» Dy scCk =U) eee eeeeceeceeacveseceenaceece ceoccieceece( 2) 


where y is an nx1 model output vector 


A (k), B , (k) and D,(k) are time-varying model parameter 
matrices. 


Defining an error vector, ¢(k): 


a 


E(k) = yk) - y(k) Ceeeee Ceeneswloweceeesecaeocvesetesese eta) 


and: 


It would normally be assumed that n=m, ie. that the 
open-loop plant transfer matrix is square. 
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v(k) = Y Cy ECK — LT) ceccccercccsseresesccecsccccccee( 4) 


h 
E(k) = 2 Ai Jal (9 Tat: i) + i wlk) dleleid € 6 061666 6. 6\410,4 01/4 @ Ce eS) 
i=] 
wheres 
h 1 
uv =__ ~ ee | + ah =_ . 
wlk) he (A. A,(k)) yk i? x (By(k) B;) 
{=| j=l 
g g 
ulk - j) + y (D,(k) - D,? AC ee 2s »» Qi EVCKyR 1) 
1=1 1=1 
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wi(k) = -w(k) Sie ace 66 athe eivlersic cletels slaletetele «6 elalaie’s 661414 0.6.0.6 66.7) 


Equations (3) - (7) describe an autoncmous, discrete 


nonlinear, feedback system as depicted in Figure A5-2.1. 


Further, if only those pairs (v(K) ow, (K)) such that: 
Sl 
n€Koeki) = 92 vik) walk) > = X6 Yiies ek Gules cea 
k=ky 


where }\ is a finite constant only dependent on the initial 
(@) 
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FIGURE A5-2.1 AUTONOMOUS NONLINEAR FEEDBACK IDENTIFICATION 
SYSTEM 
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system state, are considered, then it is possible to obtain 
sufficient conditions such that the system, described by 
equations (3) - (7) and inequality (8), is asymptotically 


hyperstable. 


Se ee Se eee ee eee om ee 


Sufficient conditions such that the system, described 
by equations (3) - (7) and inequality (8), is asymptotic 


hyperstable, are: 


h 
(i) G(z)=C(z) (I - 5 A, z+) -1/2\I is a positive 
Gina ics Pees % 
real discrete transfer matrix; 
(ii) 
(Aj(k) - Ay) vk - i) Cite ion) 
(Bj(k) - By) ulk - Jj) Clie 1-5 eth) 
(Di(k) - Dy) E(k - 1) (l=1> ge) 
DY Stgur- Gly a4 4 -'g) 


and vy, are all of the same dimension; 
(iii) The adaptation laws for ONG Sie B  (k) and 


D , (k) must admit the following nonlinear 
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coefficients and, 


(iv) v(k) is bounded. 
The proof is analogous to that given for Theorem 5.3. 


The inclusion of unmeasurable disturbances, thus, 


necessitates the inclusion of one more condition such that 


inequality (8) is satisfied. 


The addition of this extra condition should come as no 


surprise as the guarantee of hyperstability, as noted by 


Thathachar and Gajendran [41], implies that ¥ (k) is bounded. 


In simplistic terms, this may be rationalized easily. Since 


hyperstability, in the configuration presently adopted, 


demands that the nonlinearity satisfies a boundedness 


condition (inequality (8)) and G(z), the linear part, is 


positive real discrete, which implies absolute stability, 
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then the output of the linear part, v(k), must be bounded. 


Unfortunately, at each sampling instant, v (k) must be 
calculated. This is a function of the, as yet, unknown ¢€(k), 
thus, equation (4) cannot be used. Another approach is, 


however, available: 


From equations (2) - (4): 
h f 
vk) = -y(k) + 2 asl) vOk - 1) + 5 BoCk) uk - J) + 
i=1 j=1 J 
28 Py i 
oF D(C kK) ECk = Gb) i DY, Cc. eCk i) eoecccceccccecesccee( GD) 
WS) TI 
Or, in scalar form: 
De on {Une ot 
Veto y. Ck), + eae (k) ¥ (k - i) + y m 6. («) 
3 5 i=lq=1 ee j=lq=l ce 
S. Pp Pio 
Weck) = ji) + ph aaa Fitg que (ain. We 2 z Cita 
1=l1q=1 i=lq=1 
€ (Ck a i) oie a 00s 6 eevsieieialdece wisis slelaeinveleleevele.s 6 .d)e.6.0 estee eee st LU) 


Introducing the parameter adaptation laws, of Theoren 


A5-2.1, in equation (10), one has: 
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(li) The Control Scheme 


A very Similar analysis, for the effect of unmeasurable 
disturbances on the overall control scheme of the proposed 


method, may be carried out. 


Suppose that the closed-loop plant satisfies an 


input-output relation of the form: 


h is 
¥yGk) = PAL Ci ye om ad Wi a eee Glo) OC i lg) 

ARP Ss j=1 JP 
& g 

1 — + my oe eecVeeeceeenvnee 00 @ 15 
a Dip t*) &Ck L) so Ble ENC kK L) ( ) 


The assumption is also made that €'(k-1), the 


unmeasurable disturbances, are bounded. 


A reference model is then chosen such that: 
h fi 
Sr ClO)! = Aim vCk a SG ) Bim Pek c= 4g). + 


1 J 
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where h sh, £,<f, and g, $9 
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Using the definitions given by equations (3) and (4), 


one can write: 


h 
1 
E(k) = Z Ain Ok — 1) Oh iw te) ececcenevecccccesccecsee( 17) 
i=l 
where: 
hy h 
Ea) CR re Ag (ION i eres PNET Slo OH ir 
i=l f=hy tl 
fi £ 
Py Bey Ck) Ok >) 9) Ge ELOT NY abalGi'ai Pea A Ia 
= rae pa 
8} g 
TA Ge pa 2s)? ECA = Mey ania a Bip) E(k - Ll) - 
1=1 tS easel 
& 
>; El €*(k Sad L) alaileveretereletatetetevelerete ateleleielele)slelelerelererererelete (lle) 
1=1 
ands 
wi(k) = -w( k ) oo gtellalewheleleie anetla eloleveralelsieleleleresesiere eles siere es eteluly 


Equations (3), 


discrete, nonlinear feedback systen. 


Once more, only those pairs (V,W 


(4), 


(17) 


(19) 


describe an autonomous 


) which satisfy the 


boundedness condition, given by inequality (8), are 


considered. 


Thus we may write: 
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Sufficient conditions such that the system, described 
by equations (3), (4), (17) - (19) and inequality (8), is an 
asymptotic hyperstable system, are: 


hy 
(i) G(z)=D,(z) (1-2 Minar is positive real, 
my i ; ae 


discrete; 

(ii) 
Car aa BCE) vk aD Ole thy) 
Aip(k) v(x - i) Ci = hy + i +h) 
CDi Bip Ee) ee ay) China Nitti) 
DN ie oe So ae (eo io ore Sas eee 2 
CLain - 2ip(k)) Cie me Y CU era tes 5) 
Dipl *) ECia— ty GUTS Sad. ie log 
Lip E(k - 1) Cl = 13") 


and v are all of the same dimension; 
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Sader. ore vat ) ae a 
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6 . . . 
teak Pita and 1tq are strictly positive 


constants and, 


(iv) v(k) is bounded. 


The proof is analogous to that given for Theorem Sate 


Again v(k+1) must be calculated, and this may be done 
in an analogous fashion to the method given in Chapter Five 


(equations (18) - (20)). 
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The conditions in the previous pages describe a systen 


such as that depicted in Figure A5-2.2. 


As with the scheme depicted in Figure 5.8 of Chapter 
Five, the closed-loop matrices of the plant are not directly 
accessible to adaptation. Therefore, computation methods for 
calculating the parameter matrices of the two 


compensator/controllers, K, and K» must be outlined. 


With the configuration of Figure A5-2.2, it is possible 


oO write: 


YeSi0d 419 o, hi) 2 Gon Bite 4 Gl © Son Ba) 1 CG, + Son Ke) a5 


glsteietotaterdte e666 @:a:46 4606 6 ele Gralalate eels, 616 Gia lalece.e ee e1010.0:610. e082 0.) 


OT: 


y= Ri rt Bo & 6 bd wleletu ele lero eisle eleisbs ea eie.e0 wieleree.e s'o\6- ee eare( 2a) 


where: 

R, (@) is the closed-loop transfer matrix denoting the 
relationship between the outputs and setpoints, and 
R, (2) is the closed-loop transfer matrix denoting the 


relationship between the outputs and the disturbances. 


Using equations (20) and C2 yrs 
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CLOSED-LOOP 


REFERENCE 
MODEL 


ADAPTATION 
ALGORITHM 
2 


FIGURE A5-2.2 AUGMENTED OUTPUT MODEL REFERENCE ADAPTIVE 
SYSTEM WITH DISTURBANCES PRESENT 


ie 


ys, : ’ iJ 


: * lg! *, APs a? P. al _ 


” a > 4 
SUITINGR LIMAAIER IXC0R THO aeseauens S65°84 Sahn? -¢ 
THUSEAY BION ABS HPL eye, | zt 


4O4 


= + te fhe! Blalitcleta 6 ee Shaeletisee ceeeee elce 
Riz) (L Eo, Bt? Go, & 
Or, upon rearrangement: 


“a 


Go, Bi = CLS Gor Ki) R1 


Sovthat: 
Kaz) «= car Bi(z) CL — Br zd! covccccccccccccccces el 23) 
and: 
Betz) Oly & Gy Se ($1 A een Eo ) 
which implies that: 
Go, be = (lt a Eid} B2) = Ge 
and: 


Ko(z) = Sot (z) (L + G2) Bitz) Ra(z) - §.(z) eile seca) 


In order that equations (23) and (24) be defined, it is 


necessary that G 6, (2) and (I = R ,(2)) be invertible. 


It would appear that the major problem involved in the 
implementation of the scheme, outlined, is that of 
dimensionality since calculations of K_ and K, require 
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inversion of large matrix polynomials on-line. A practical 
alternative, to this approach, has been discussed in 
Appendix 5-1. 


Nonlinear Plants 


Since the stability approaches are based on an 
equivalent nonlinear autonomous feedback system 
[42\= 51,54], it as natural to “expect: that some some’ type of 


limited nonlinear plant behaviour could be tolerated. 


A very obvious choice is a bounded nonlinearity. This 
enters the formulation in the same way as do unmeasurable 
disturbances. Once again the identification system will be 
affected, but as accurate parameter identification is only 


of secondary consideration, this is of little consequence. 


Theorems A5.2-1 and A5.2-2 determine the stability of 
the control system when bounded nonlinearities are present 
and the development of the previous sections are directly 


applicable to this situation. 
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Multivariable Simulation Run Data 


Systen fi 
2/¢s + 1) 1/(s +9) 
PGs. ic) UsiiCe: + 2) 
System 11 
2/(s + 1) T/iCsre 1) 
/Ge, +915) 1/(s + 10)? 
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RUNS Up oro Sete oe 
Run Time = 100 minutes 
Sampling Time = 60 seconds 


1 es) 
Excitation Mode: setpoint change ( 1 1? @ 20 minutes 


Initial Identification: 
Excitation Mode: zero mean gaussian input 


sequence in both elements of the control 


vectors 
elenent 12 (side) ;= OeiZ 
elenent (22 s.d.0= 0.3 


Initial identification adaptive loop gain 


matrices: 


-100 -100 


=LO0 -100 


Initial identification model parameter matrices 
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were all zero except for B): 


a 1 a) 
Bs 
0 1 
System II! 
LACS Ft jCSea. +h) 1/(0.eis + 1) 
PICO cis + 314 1/(Se © 1)CO<2s + 1) 
RUNS 6, Te 
Run Time = 100 minutes 
Sampling Tite = 60 seconds 


6.0 
Excitation Mode: setpoint change (9. 4 )@ 20 minutes 


Initial Identification: 


Excitation Mode: step input change in both 
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elements of the control vector: 


RUN 6 
Step 1 

element 1: step = 1.1 
element 2: step = 1.2 
tine = 4 minutes 

Step 2 
element 1: step = 1.15 
element 2: step = 1.1 
time = 10 minutes 

Step 3 
element 1: step = 1.05 
element 2: step = 1.15 
time = 15 minutes 

RUN 7 

Step 1 
element 1: step = 1.1 
element 2: step = 1.15 
time = 5 minutes 

Step 2 
element 1: step = 1.2 
element 2: step = 1.1 


time = 15 minutes 
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Initial adaptive identification loop gain 


matrices: 


=100 -1900 


-1090 =O 


Initial identification model parameter 


matrices: 
et 0.9 -0.3 0.0 
A2 = 
0.0 Peo 0.9 0.0 
0.0 19.0 0.1 -11.0 
B2= 

10.0 CG.0 -8.0 0.2 
0.0 3.0 

Bane 
0.0 0.9 
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The initial desired adaptive model parameter matrices in all 
cases were set egual to zero. Further, in all runs the 


reference model was set equal to Hs 
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